2023-09-26 07:01:00,579 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-26 07:01:00,783 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d 2023-09-26 07:01:00,784 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-26 07:01:00,784 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-26 07:01:00,822 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-26 07:01:01,068 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-26 07:01:01,069 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/cluster_4e183e78-ccf4-5782-402b-e9b6bcc58056, deleteOnExit=true 2023-09-26 07:01:01,069 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-26 07:01:01,069 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/test.cache.data in system properties and HBase conf 2023-09-26 07:01:01,070 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/hadoop.tmp.dir in system properties and HBase conf 2023-09-26 07:01:01,070 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/hadoop.log.dir in system properties and HBase conf 2023-09-26 07:01:01,070 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-26 07:01:01,071 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-26 07:01:01,071 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-26 07:01:01,392 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-26 07:01:01,397 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-26 07:01:01,398 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-26 07:01:01,398 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-26 07:01:01,398 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-26 07:01:01,399 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-26 07:01:01,399 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-26 07:01:01,400 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-26 07:01:01,400 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-26 07:01:01,401 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-26 07:01:01,401 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/nfs.dump.dir in system properties and HBase conf 2023-09-26 07:01:01,401 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/java.io.tmpdir in system properties and HBase conf 2023-09-26 07:01:01,402 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-26 07:01:01,402 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-26 07:01:01,403 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-26 07:01:01,972 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-26 07:01:01,977 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-26 07:01:02,292 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-26 07:01:02,477 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-26 07:01:02,492 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-26 07:01:02,530 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-26 07:01:02,565 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/java.io.tmpdir/Jetty_localhost_40999_hdfs____.nyz7eh/webapp 2023-09-26 07:01:02,714 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40999 2023-09-26 07:01:02,726 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-26 07:01:02,726 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-26 07:01:03,250 WARN [Listener at localhost/36301] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-26 07:01:03,352 WARN [Listener at localhost/36301] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-26 07:01:03,382 WARN [Listener at localhost/36301] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-26 07:01:03,443 INFO [Listener at localhost/36301] log.Slf4jLog(67): jetty-6.1.26 2023-09-26 07:01:03,452 INFO [Listener at localhost/36301] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/java.io.tmpdir/Jetty_localhost_42015_datanode____ynsvel/webapp 2023-09-26 07:01:03,596 INFO [Listener at localhost/36301] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42015 2023-09-26 07:01:04,002 WARN [Listener at localhost/40069] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-26 07:01:04,016 WARN [Listener at localhost/40069] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-26 07:01:04,022 WARN [Listener at localhost/40069] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-26 07:01:04,025 INFO [Listener at localhost/40069] log.Slf4jLog(67): jetty-6.1.26 2023-09-26 07:01:04,035 INFO [Listener at localhost/40069] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/java.io.tmpdir/Jetty_localhost_39323_datanode____tbeq9h/webapp 2023-09-26 07:01:04,149 INFO [Listener at localhost/40069] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39323 2023-09-26 07:01:04,161 WARN [Listener at localhost/36045] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-26 07:01:04,192 WARN [Listener at localhost/36045] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-26 07:01:04,197 WARN [Listener at localhost/36045] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-26 07:01:04,200 INFO [Listener at localhost/36045] log.Slf4jLog(67): jetty-6.1.26 2023-09-26 07:01:04,212 INFO [Listener at localhost/36045] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/java.io.tmpdir/Jetty_localhost_37175_datanode____fuz0pe/webapp 2023-09-26 07:01:04,363 INFO [Listener at localhost/36045] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37175 2023-09-26 07:01:04,380 WARN [Listener at localhost/33837] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-26 07:01:04,613 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc7dbb6b8e5a0eac4: Processing first storage report for DS-da28763d-838c-4c86-9f74-e02f9cc8e4ae from datanode 529aaa97-60bb-4876-89f9-207f04b36d1c 2023-09-26 07:01:04,615 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc7dbb6b8e5a0eac4: from storage DS-da28763d-838c-4c86-9f74-e02f9cc8e4ae node DatanodeRegistration(127.0.0.1:39531, datanodeUuid=529aaa97-60bb-4876-89f9-207f04b36d1c, infoPort=40169, infoSecurePort=0, ipcPort=33837, storageInfo=lv=-57;cid=testClusterID;nsid=1154263603;c=1695711662063), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-26 07:01:04,615 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x86ae5216ded6a4e6: Processing first storage report for DS-20c0ae80-c373-4cde-a6d4-8bd884bb903c from datanode db609152-d400-46c1-960f-4c86258958f0 2023-09-26 07:01:04,615 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x86ae5216ded6a4e6: from storage DS-20c0ae80-c373-4cde-a6d4-8bd884bb903c node DatanodeRegistration(127.0.0.1:37323, datanodeUuid=db609152-d400-46c1-960f-4c86258958f0, infoPort=38497, infoSecurePort=0, ipcPort=36045, storageInfo=lv=-57;cid=testClusterID;nsid=1154263603;c=1695711662063), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-26 07:01:04,615 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xddc7d02a6738d69: Processing first storage report for DS-4a2bab15-cb27-4e16-b652-3c48baf56230 from datanode f2f50bba-2a0c-4a7d-a15d-ea61879e7122 2023-09-26 07:01:04,616 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xddc7d02a6738d69: from storage DS-4a2bab15-cb27-4e16-b652-3c48baf56230 node DatanodeRegistration(127.0.0.1:36043, datanodeUuid=f2f50bba-2a0c-4a7d-a15d-ea61879e7122, infoPort=35061, infoSecurePort=0, ipcPort=40069, storageInfo=lv=-57;cid=testClusterID;nsid=1154263603;c=1695711662063), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-26 07:01:04,616 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc7dbb6b8e5a0eac4: Processing first storage report for DS-51c9285a-71ba-4945-9b27-e792cca63d62 from datanode 529aaa97-60bb-4876-89f9-207f04b36d1c 2023-09-26 07:01:04,616 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc7dbb6b8e5a0eac4: from storage DS-51c9285a-71ba-4945-9b27-e792cca63d62 node DatanodeRegistration(127.0.0.1:39531, datanodeUuid=529aaa97-60bb-4876-89f9-207f04b36d1c, infoPort=40169, infoSecurePort=0, ipcPort=33837, storageInfo=lv=-57;cid=testClusterID;nsid=1154263603;c=1695711662063), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-26 07:01:04,616 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x86ae5216ded6a4e6: Processing first storage report for DS-7fead2d1-3fb0-4302-b1e6-3676e2429610 from datanode db609152-d400-46c1-960f-4c86258958f0 2023-09-26 07:01:04,616 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x86ae5216ded6a4e6: from storage DS-7fead2d1-3fb0-4302-b1e6-3676e2429610 node DatanodeRegistration(127.0.0.1:37323, datanodeUuid=db609152-d400-46c1-960f-4c86258958f0, infoPort=38497, infoSecurePort=0, ipcPort=36045, storageInfo=lv=-57;cid=testClusterID;nsid=1154263603;c=1695711662063), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-26 07:01:04,616 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xddc7d02a6738d69: Processing first storage report for DS-3e74e41b-c3bf-4d28-8106-3ed7c2c754a1 from datanode f2f50bba-2a0c-4a7d-a15d-ea61879e7122 2023-09-26 07:01:04,616 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xddc7d02a6738d69: from storage DS-3e74e41b-c3bf-4d28-8106-3ed7c2c754a1 node DatanodeRegistration(127.0.0.1:36043, datanodeUuid=f2f50bba-2a0c-4a7d-a15d-ea61879e7122, infoPort=35061, infoSecurePort=0, ipcPort=40069, storageInfo=lv=-57;cid=testClusterID;nsid=1154263603;c=1695711662063), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-26 07:01:04,857 DEBUG [Listener at localhost/33837] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d 2023-09-26 07:01:04,956 INFO [Listener at localhost/33837] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/cluster_4e183e78-ccf4-5782-402b-e9b6bcc58056/zookeeper_0, clientPort=50261, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/cluster_4e183e78-ccf4-5782-402b-e9b6bcc58056/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/cluster_4e183e78-ccf4-5782-402b-e9b6bcc58056/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-26 07:01:04,978 INFO [Listener at localhost/33837] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50261 2023-09-26 07:01:04,986 INFO [Listener at localhost/33837] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-26 07:01:04,988 INFO [Listener at localhost/33837] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-26 07:01:05,694 INFO [Listener at localhost/33837] util.FSUtils(471): Created version file at hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1 with version=8 2023-09-26 07:01:05,694 INFO [Listener at localhost/33837] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/hbase-staging 2023-09-26 07:01:06,060 INFO [Listener at localhost/33837] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-26 07:01:06,566 INFO [Listener at localhost/33837] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-26 07:01:06,599 INFO [Listener at localhost/33837] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-26 07:01:06,599 INFO [Listener at localhost/33837] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-26 07:01:06,600 INFO [Listener at localhost/33837] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-26 07:01:06,600 INFO [Listener at localhost/33837] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-26 07:01:06,600 INFO [Listener at localhost/33837] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-26 07:01:06,751 INFO [Listener at localhost/33837] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-26 07:01:06,826 DEBUG [Listener at localhost/33837] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-26 07:01:06,920 INFO [Listener at localhost/33837] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38147 2023-09-26 07:01:06,933 INFO [Listener at localhost/33837] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-26 07:01:06,935 INFO [Listener at localhost/33837] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-26 07:01:06,959 INFO [Listener at localhost/33837] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38147 connecting to ZooKeeper ensemble=127.0.0.1:50261 2023-09-26 07:01:07,024 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:381470x0, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-26 07:01:07,027 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38147-0x100e709d2ca0000 connected 2023-09-26 07:01:07,057 DEBUG [Listener at localhost/33837] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-26 07:01:07,058 DEBUG [Listener at localhost/33837] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-26 07:01:07,071 DEBUG [Listener at localhost/33837] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-26 07:01:07,079 DEBUG [Listener at localhost/33837] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38147 2023-09-26 07:01:07,080 DEBUG [Listener at localhost/33837] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38147 2023-09-26 07:01:07,080 DEBUG [Listener at localhost/33837] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38147 2023-09-26 07:01:07,081 DEBUG [Listener at localhost/33837] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38147 2023-09-26 07:01:07,082 DEBUG [Listener at localhost/33837] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38147 2023-09-26 07:01:07,088 INFO [Listener at localhost/33837] master.HMaster(444): hbase.rootdir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1, hbase.cluster.distributed=false 2023-09-26 07:01:07,152 INFO [Listener at localhost/33837] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-26 07:01:07,153 INFO [Listener at localhost/33837] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-26 07:01:07,153 INFO [Listener at localhost/33837] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-26 07:01:07,153 INFO [Listener at localhost/33837] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-26 07:01:07,153 INFO [Listener at localhost/33837] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-26 07:01:07,153 INFO [Listener at localhost/33837] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-26 07:01:07,158 INFO [Listener at localhost/33837] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-26 07:01:07,161 INFO [Listener at localhost/33837] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42373 2023-09-26 07:01:07,164 INFO [Listener at localhost/33837] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-26 07:01:07,171 INFO [Listener at localhost/33837] mob.MobFileCache(124): MobFileCache disabled 2023-09-26 07:01:07,173 INFO [Listener at localhost/33837] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-26 07:01:07,176 INFO [Listener at localhost/33837] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-26 07:01:07,179 INFO [Listener at localhost/33837] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42373 connecting to ZooKeeper ensemble=127.0.0.1:50261 2023-09-26 07:01:07,183 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:423730x0, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-26 07:01:07,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42373-0x100e709d2ca0001 connected 2023-09-26 07:01:07,184 DEBUG [Listener at localhost/33837] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-26 07:01:07,186 DEBUG [Listener at localhost/33837] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-26 07:01:07,187 DEBUG [Listener at localhost/33837] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-26 07:01:07,188 DEBUG [Listener at localhost/33837] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42373 2023-09-26 07:01:07,188 DEBUG [Listener at localhost/33837] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42373 2023-09-26 07:01:07,188 DEBUG [Listener at localhost/33837] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42373 2023-09-26 07:01:07,193 DEBUG [Listener at localhost/33837] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42373 2023-09-26 07:01:07,193 DEBUG [Listener at localhost/33837] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42373 2023-09-26 07:01:07,206 INFO [Listener at localhost/33837] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-26 07:01:07,207 INFO [Listener at localhost/33837] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-26 07:01:07,207 INFO [Listener at localhost/33837] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-26 07:01:07,208 INFO [Listener at localhost/33837] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-26 07:01:07,208 INFO [Listener at localhost/33837] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-26 07:01:07,208 INFO [Listener at localhost/33837] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-26 07:01:07,208 INFO [Listener at localhost/33837] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-26 07:01:07,210 INFO [Listener at localhost/33837] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39873 2023-09-26 07:01:07,210 INFO [Listener at localhost/33837] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-26 07:01:07,211 INFO [Listener at localhost/33837] mob.MobFileCache(124): MobFileCache disabled 2023-09-26 07:01:07,212 INFO [Listener at localhost/33837] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-26 07:01:07,214 INFO [Listener at localhost/33837] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-26 07:01:07,224 INFO [Listener at localhost/33837] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39873 connecting to ZooKeeper ensemble=127.0.0.1:50261 2023-09-26 07:01:07,227 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:398730x0, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-26 07:01:07,229 DEBUG [Listener at localhost/33837] zookeeper.ZKUtil(164): regionserver:398730x0, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-26 07:01:07,229 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39873-0x100e709d2ca0002 connected 2023-09-26 07:01:07,230 DEBUG [Listener at localhost/33837] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-26 07:01:07,231 DEBUG [Listener at localhost/33837] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-26 07:01:07,232 DEBUG [Listener at localhost/33837] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39873 2023-09-26 07:01:07,233 DEBUG [Listener at localhost/33837] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39873 2023-09-26 07:01:07,236 DEBUG [Listener at localhost/33837] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39873 2023-09-26 07:01:07,238 DEBUG [Listener at localhost/33837] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39873 2023-09-26 07:01:07,238 DEBUG [Listener at localhost/33837] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39873 2023-09-26 07:01:07,251 INFO [Listener at localhost/33837] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-26 07:01:07,251 INFO [Listener at localhost/33837] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-26 07:01:07,251 INFO [Listener at localhost/33837] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-26 07:01:07,251 INFO [Listener at localhost/33837] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-26 07:01:07,251 INFO [Listener at localhost/33837] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-26 07:01:07,252 INFO [Listener at localhost/33837] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-26 07:01:07,252 INFO [Listener at localhost/33837] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-26 07:01:07,253 INFO [Listener at localhost/33837] ipc.NettyRpcServer(120): Bind to /172.31.14.131:32791 2023-09-26 07:01:07,254 INFO [Listener at localhost/33837] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-26 07:01:07,254 INFO [Listener at localhost/33837] mob.MobFileCache(124): MobFileCache disabled 2023-09-26 07:01:07,255 INFO [Listener at localhost/33837] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-26 07:01:07,258 INFO [Listener at localhost/33837] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-26 07:01:07,261 INFO [Listener at localhost/33837] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:32791 connecting to ZooKeeper ensemble=127.0.0.1:50261 2023-09-26 07:01:07,265 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:327910x0, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-26 07:01:07,266 DEBUG [Listener at localhost/33837] zookeeper.ZKUtil(164): regionserver:327910x0, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-26 07:01:07,266 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:32791-0x100e709d2ca0003 connected 2023-09-26 07:01:07,267 DEBUG [Listener at localhost/33837] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-26 07:01:07,267 DEBUG [Listener at localhost/33837] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-26 07:01:07,268 DEBUG [Listener at localhost/33837] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32791 2023-09-26 07:01:07,268 DEBUG [Listener at localhost/33837] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32791 2023-09-26 07:01:07,269 DEBUG [Listener at localhost/33837] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32791 2023-09-26 07:01:07,270 DEBUG [Listener at localhost/33837] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32791 2023-09-26 07:01:07,270 DEBUG [Listener at localhost/33837] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32791 2023-09-26 07:01:07,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38147,1695711665890 2023-09-26 07:01:07,283 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-26 07:01:07,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38147,1695711665890 2023-09-26 07:01:07,305 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-26 07:01:07,305 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-26 07:01:07,305 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-26 07:01:07,305 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-26 07:01:07,305 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-26 07:01:07,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-26 07:01:07,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38147,1695711665890 from backup master directory 2023-09-26 07:01:07,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-26 07:01:07,314 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38147,1695711665890 2023-09-26 07:01:07,315 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-26 07:01:07,315 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-26 07:01:07,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38147,1695711665890 2023-09-26 07:01:07,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-26 07:01:07,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-26 07:01:07,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/hbase.id with ID: 8f118c73-f728-4a2e-a755-98e299491162 2023-09-26 07:01:07,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-26 07:01:07,487 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-26 07:01:07,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x08901546 to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:01:07,581 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c71ed8f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:01:07,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-26 07:01:07,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-26 07:01:07,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-26 07:01:07,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-26 07:01:07,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-26 07:01:07,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-26 07:01:07,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-26 07:01:07,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/MasterData/data/master/store-tmp 2023-09-26 07:01:07,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:01:07,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-26 07:01:07,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-26 07:01:07,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-26 07:01:07,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-26 07:01:07,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-26 07:01:07,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-26 07:01:07,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-26 07:01:07,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/MasterData/WALs/jenkins-hbase4.apache.org,38147,1695711665890 2023-09-26 07:01:07,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38147%2C1695711665890, suffix=, logDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/MasterData/WALs/jenkins-hbase4.apache.org,38147,1695711665890, archiveDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/MasterData/oldWALs, maxLogs=10 2023-09-26 07:01:07,796 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37323,DS-20c0ae80-c373-4cde-a6d4-8bd884bb903c,DISK] 2023-09-26 07:01:07,796 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39531,DS-da28763d-838c-4c86-9f74-e02f9cc8e4ae,DISK] 2023-09-26 07:01:07,796 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36043,DS-4a2bab15-cb27-4e16-b652-3c48baf56230,DISK] 2023-09-26 07:01:07,805 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-26 07:01:07,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/MasterData/WALs/jenkins-hbase4.apache.org,38147,1695711665890/jenkins-hbase4.apache.org%2C38147%2C1695711665890.1695711667745 2023-09-26 07:01:07,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37323,DS-20c0ae80-c373-4cde-a6d4-8bd884bb903c,DISK], DatanodeInfoWithStorage[127.0.0.1:39531,DS-da28763d-838c-4c86-9f74-e02f9cc8e4ae,DISK], DatanodeInfoWithStorage[127.0.0.1:36043,DS-4a2bab15-cb27-4e16-b652-3c48baf56230,DISK]] 2023-09-26 07:01:07,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-26 07:01:07,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:01:07,878 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-26 07:01:07,879 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-26 07:01:07,942 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-26 07:01:07,949 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-26 07:01:07,977 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-26 07:01:07,989 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:01:07,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-26 07:01:07,997 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-26 07:01:08,013 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-26 07:01:08,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 07:01:08,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61627269, jitterRate=-0.08168213069438934}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 07:01:08,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-26 07:01:08,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-26 07:01:08,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-26 07:01:08,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-26 07:01:08,045 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-26 07:01:08,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-26 07:01:08,084 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 36 msec 2023-09-26 07:01:08,084 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-26 07:01:08,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-26 07:01:08,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-26 07:01:08,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-26 07:01:08,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-26 07:01:08,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-26 07:01:08,156 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.SimpleRegionNormalizer(156): Updated configuration for key 'hbase.normalizer.merge.merge_request_max_number_of_regions' from 100 to 50 2023-09-26 07:01:08,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-26 07:01:08,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-26 07:01:08,166 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-26 07:01:08,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-26 07:01:08,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-26 07:01:08,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-26 07:01:08,189 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-26 07:01:08,189 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-26 07:01:08,189 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-26 07:01:08,189 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-26 07:01:08,189 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-26 07:01:08,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38147,1695711665890, sessionid=0x100e709d2ca0000, setting cluster-up flag (Was=false) 2023-09-26 07:01:08,213 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-26 07:01:08,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-26 07:01:08,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38147,1695711665890 2023-09-26 07:01:08,230 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-26 07:01:08,236 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-26 07:01:08,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38147,1695711665890 2023-09-26 07:01:08,241 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp 2023-09-26 07:01:08,276 INFO [RS:0;jenkins-hbase4:42373] regionserver.HRegionServer(951): ClusterId : 8f118c73-f728-4a2e-a755-98e299491162 2023-09-26 07:01:08,276 INFO [RS:2;jenkins-hbase4:32791] regionserver.HRegionServer(951): ClusterId : 8f118c73-f728-4a2e-a755-98e299491162 2023-09-26 07:01:08,282 INFO [RS:1;jenkins-hbase4:39873] regionserver.HRegionServer(951): ClusterId : 8f118c73-f728-4a2e-a755-98e299491162 2023-09-26 07:01:08,290 DEBUG [RS:0;jenkins-hbase4:42373] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-26 07:01:08,290 DEBUG [RS:1;jenkins-hbase4:39873] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-26 07:01:08,290 DEBUG [RS:2;jenkins-hbase4:32791] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-26 07:01:08,298 DEBUG [RS:2;jenkins-hbase4:32791] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-26 07:01:08,298 DEBUG [RS:1;jenkins-hbase4:39873] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-26 07:01:08,298 DEBUG [RS:0;jenkins-hbase4:42373] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-26 07:01:08,298 DEBUG [RS:1;jenkins-hbase4:39873] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-26 07:01:08,298 DEBUG [RS:2;jenkins-hbase4:32791] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-26 07:01:08,298 DEBUG [RS:0;jenkins-hbase4:42373] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-26 07:01:08,304 DEBUG [RS:0;jenkins-hbase4:42373] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-26 07:01:08,304 DEBUG [RS:1;jenkins-hbase4:39873] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-26 07:01:08,304 DEBUG [RS:2;jenkins-hbase4:32791] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-26 07:01:08,309 DEBUG [RS:1;jenkins-hbase4:39873] zookeeper.ReadOnlyZKClient(139): Connect 0x3954eb73 to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:01:08,310 DEBUG [RS:0;jenkins-hbase4:42373] zookeeper.ReadOnlyZKClient(139): Connect 0x749237b6 to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:01:08,311 DEBUG [RS:2;jenkins-hbase4:32791] zookeeper.ReadOnlyZKClient(139): Connect 0x7ddad224 to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:01:08,324 DEBUG [RS:1;jenkins-hbase4:39873] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37931229, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:01:08,325 DEBUG [RS:1;jenkins-hbase4:39873] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33ac8003, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-26 07:01:08,348 DEBUG [RS:0;jenkins-hbase4:42373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a55d754, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:01:08,348 DEBUG [RS:2;jenkins-hbase4:32791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@731d33ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:01:08,348 DEBUG [RS:0;jenkins-hbase4:42373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e6a5cc6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-26 07:01:08,349 DEBUG [RS:2;jenkins-hbase4:32791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7722b954, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-26 07:01:08,371 DEBUG [RS:1;jenkins-hbase4:39873] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39873 2023-09-26 07:01:08,374 DEBUG [RS:0;jenkins-hbase4:42373] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42373 2023-09-26 07:01:08,376 DEBUG [RS:2;jenkins-hbase4:32791] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:32791 2023-09-26 07:01:08,376 INFO [RS:1;jenkins-hbase4:39873] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-26 07:01:08,377 INFO [RS:2;jenkins-hbase4:32791] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-26 07:01:08,377 INFO [RS:2;jenkins-hbase4:32791] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-26 07:01:08,376 INFO [RS:0;jenkins-hbase4:42373] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-26 07:01:08,377 INFO [RS:1;jenkins-hbase4:39873] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-26 07:01:08,377 INFO [RS:0;jenkins-hbase4:42373] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-26 07:01:08,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-26 07:01:08,386 DEBUG [RS:0;jenkins-hbase4:42373] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-26 07:01:08,386 DEBUG [RS:1;jenkins-hbase4:39873] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-26 07:01:08,386 DEBUG [RS:2;jenkins-hbase4:32791] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-26 07:01:08,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 07:01:08,388 INFO [RS:0;jenkins-hbase4:42373] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 07:01:08,388 INFO [RS:2;jenkins-hbase4:32791] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 07:01:08,388 DEBUG [RS:0;jenkins-hbase4:42373] regionserver.HRegionServer(1022): About to register with Master. 2023-09-26 07:01:08,388 INFO [RS:1;jenkins-hbase4:39873] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 07:01:08,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-26 07:01:08,388 DEBUG [RS:2;jenkins-hbase4:32791] regionserver.HRegionServer(1022): About to register with Master. 2023-09-26 07:01:08,388 DEBUG [RS:1;jenkins-hbase4:39873] regionserver.HRegionServer(1022): About to register with Master. 2023-09-26 07:01:08,391 INFO [RS:1;jenkins-hbase4:39873] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38147,1695711665890 with isa=jenkins-hbase4.apache.org/172.31.14.131:39873, startcode=1695711667206 2023-09-26 07:01:08,391 INFO [RS:0;jenkins-hbase4:42373] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38147,1695711665890 with isa=jenkins-hbase4.apache.org/172.31.14.131:42373, startcode=1695711667152 2023-09-26 07:01:08,391 INFO [RS:2;jenkins-hbase4:32791] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38147,1695711665890 with isa=jenkins-hbase4.apache.org/172.31.14.131:32791, startcode=1695711667250 2023-09-26 07:01:08,410 DEBUG [RS:1;jenkins-hbase4:39873] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-26 07:01:08,410 DEBUG [RS:0;jenkins-hbase4:42373] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-26 07:01:08,410 DEBUG [RS:2;jenkins-hbase4:32791] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-26 07:01:08,473 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43971, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-26 07:01:08,473 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52233, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-26 07:01:08,473 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49409, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-26 07:01:08,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-26 07:01:08,485 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38147] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-26 07:01:08,495 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-26 07:01:08,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-26 07:01:08,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-26 07:01:08,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-26 07:01:08,497 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-26 07:01:08,497 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38147] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-26 07:01:08,497 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,497 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-26 07:01:08,497 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,497 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38147] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-26 07:01:08,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695711698500 2023-09-26 07:01:08,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-26 07:01:08,508 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-26 07:01:08,509 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-26 07:01:08,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-26 07:01:08,515 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-26 07:01:08,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-26 07:01:08,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-26 07:01:08,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-26 07:01:08,522 DEBUG [RS:1;jenkins-hbase4:39873] regionserver.HRegionServer(2830): Master is not running yet 2023-09-26 07:01:08,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-26 07:01:08,523 WARN [RS:1;jenkins-hbase4:39873] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-26 07:01:08,522 DEBUG [RS:2;jenkins-hbase4:32791] regionserver.HRegionServer(2830): Master is not running yet 2023-09-26 07:01:08,522 DEBUG [RS:0;jenkins-hbase4:42373] regionserver.HRegionServer(2830): Master is not running yet 2023-09-26 07:01:08,523 WARN [RS:2;jenkins-hbase4:32791] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-26 07:01:08,523 WARN [RS:0;jenkins-hbase4:42373] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-26 07:01:08,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:08,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-26 07:01:08,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-26 07:01:08,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-26 07:01:08,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-26 07:01:08,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-26 07:01:08,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695711668532,5,FailOnTimeoutGroup] 2023-09-26 07:01:08,535 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695711668533,5,FailOnTimeoutGroup] 2023-09-26 07:01:08,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:08,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-26 07:01:08,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:08,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:08,559 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-26 07:01:08,560 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-26 07:01:08,561 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1 2023-09-26 07:01:08,582 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:01:08,584 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-26 07:01:08,587 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740/info 2023-09-26 07:01:08,588 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-26 07:01:08,589 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:01:08,589 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-26 07:01:08,592 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740/rep_barrier 2023-09-26 07:01:08,592 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-26 07:01:08,593 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:01:08,594 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-26 07:01:08,596 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740/table 2023-09-26 07:01:08,596 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-26 07:01:08,597 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:01:08,599 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740 2023-09-26 07:01:08,600 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740 2023-09-26 07:01:08,604 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-26 07:01:08,606 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-26 07:01:08,612 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 07:01:08,613 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69112636, jitterRate=0.029858529567718506}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-26 07:01:08,613 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-26 07:01:08,613 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-26 07:01:08,614 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-26 07:01:08,614 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-26 07:01:08,614 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-26 07:01:08,614 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-26 07:01:08,616 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-26 07:01:08,616 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-26 07:01:08,621 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-26 07:01:08,621 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-26 07:01:08,624 INFO [RS:2;jenkins-hbase4:32791] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38147,1695711665890 with isa=jenkins-hbase4.apache.org/172.31.14.131:32791, startcode=1695711667250 2023-09-26 07:01:08,624 INFO [RS:1;jenkins-hbase4:39873] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38147,1695711665890 with isa=jenkins-hbase4.apache.org/172.31.14.131:39873, startcode=1695711667206 2023-09-26 07:01:08,624 INFO [RS:0;jenkins-hbase4:42373] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38147,1695711665890 with isa=jenkins-hbase4.apache.org/172.31.14.131:42373, startcode=1695711667152 2023-09-26 07:01:08,632 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38147] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:08,634 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-26 07:01:08,638 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38147] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:08,639 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38147] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:08,640 DEBUG [RS:0;jenkins-hbase4:42373] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1 2023-09-26 07:01:08,640 DEBUG [RS:0;jenkins-hbase4:42373] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36301 2023-09-26 07:01:08,641 DEBUG [RS:1;jenkins-hbase4:39873] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1 2023-09-26 07:01:08,641 DEBUG [RS:0;jenkins-hbase4:42373] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-26 07:01:08,641 DEBUG [RS:1;jenkins-hbase4:39873] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36301 2023-09-26 07:01:08,642 DEBUG [RS:1;jenkins-hbase4:39873] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-26 07:01:08,642 DEBUG [RS:2;jenkins-hbase4:32791] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1 2023-09-26 07:01:08,642 DEBUG [RS:2;jenkins-hbase4:32791] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36301 2023-09-26 07:01:08,642 DEBUG [RS:2;jenkins-hbase4:32791] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-26 07:01:08,654 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-26 07:01:08,655 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-26 07:01:08,656 DEBUG [RS:2;jenkins-hbase4:32791] zookeeper.ZKUtil(162): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:08,657 WARN [RS:2;jenkins-hbase4:32791] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-26 07:01:08,657 INFO [RS:2;jenkins-hbase4:32791] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-26 07:01:08,657 DEBUG [RS:2;jenkins-hbase4:32791] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/WALs/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:08,660 DEBUG [RS:0;jenkins-hbase4:42373] zookeeper.ZKUtil(162): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:08,660 WARN [RS:0;jenkins-hbase4:42373] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-26 07:01:08,661 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-26 07:01:08,661 DEBUG [RS:1;jenkins-hbase4:39873] zookeeper.ZKUtil(162): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:08,665 INFO [RS:0;jenkins-hbase4:42373] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-26 07:01:08,665 WARN [RS:1;jenkins-hbase4:39873] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-26 07:01:08,666 DEBUG [RS:0;jenkins-hbase4:42373] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/WALs/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:08,666 INFO [RS:1;jenkins-hbase4:39873] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-26 07:01:08,666 DEBUG [RS:1;jenkins-hbase4:39873] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/WALs/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:08,667 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42373,1695711667152] 2023-09-26 07:01:08,667 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,32791,1695711667250] 2023-09-26 07:01:08,667 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39873,1695711667206] 2023-09-26 07:01:08,677 DEBUG [RS:0;jenkins-hbase4:42373] zookeeper.ZKUtil(162): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:08,677 DEBUG [RS:2;jenkins-hbase4:32791] zookeeper.ZKUtil(162): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:08,677 DEBUG [RS:1;jenkins-hbase4:39873] zookeeper.ZKUtil(162): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:08,677 DEBUG [RS:0;jenkins-hbase4:42373] zookeeper.ZKUtil(162): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:08,677 DEBUG [RS:2;jenkins-hbase4:32791] zookeeper.ZKUtil(162): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:08,678 DEBUG [RS:1;jenkins-hbase4:39873] zookeeper.ZKUtil(162): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:08,678 DEBUG [RS:0;jenkins-hbase4:42373] zookeeper.ZKUtil(162): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:08,678 DEBUG [RS:2;jenkins-hbase4:32791] zookeeper.ZKUtil(162): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:08,678 DEBUG [RS:1;jenkins-hbase4:39873] zookeeper.ZKUtil(162): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:08,690 DEBUG [RS:0;jenkins-hbase4:42373] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-26 07:01:08,690 DEBUG [RS:1;jenkins-hbase4:39873] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-26 07:01:08,690 DEBUG [RS:2;jenkins-hbase4:32791] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-26 07:01:08,701 INFO [RS:1;jenkins-hbase4:39873] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-26 07:01:08,702 INFO [RS:2;jenkins-hbase4:32791] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-26 07:01:08,701 INFO [RS:0;jenkins-hbase4:42373] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-26 07:01:08,726 INFO [RS:2;jenkins-hbase4:32791] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-26 07:01:08,726 INFO [RS:1;jenkins-hbase4:39873] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-26 07:01:08,729 INFO [RS:0;jenkins-hbase4:42373] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-26 07:01:08,731 INFO [RS:2;jenkins-hbase4:32791] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-26 07:01:08,731 INFO [RS:1;jenkins-hbase4:39873] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-26 07:01:08,731 INFO [RS:0;jenkins-hbase4:42373] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-26 07:01:08,732 INFO [RS:1;jenkins-hbase4:39873] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:08,732 INFO [RS:2;jenkins-hbase4:32791] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:08,732 INFO [RS:0;jenkins-hbase4:42373] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:08,734 INFO [RS:1;jenkins-hbase4:39873] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-26 07:01:08,734 INFO [RS:2;jenkins-hbase4:32791] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-26 07:01:08,734 INFO [RS:0;jenkins-hbase4:42373] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-26 07:01:08,743 INFO [RS:2;jenkins-hbase4:32791] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:08,743 INFO [RS:0;jenkins-hbase4:42373] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:08,743 INFO [RS:1;jenkins-hbase4:39873] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:08,743 DEBUG [RS:2;jenkins-hbase4:32791] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,743 DEBUG [RS:0;jenkins-hbase4:42373] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,743 DEBUG [RS:2;jenkins-hbase4:32791] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,743 DEBUG [RS:1;jenkins-hbase4:39873] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,744 DEBUG [RS:2;jenkins-hbase4:32791] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,744 DEBUG [RS:1;jenkins-hbase4:39873] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,744 DEBUG [RS:2;jenkins-hbase4:32791] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,744 DEBUG [RS:1;jenkins-hbase4:39873] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,744 DEBUG [RS:2;jenkins-hbase4:32791] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,744 DEBUG [RS:1;jenkins-hbase4:39873] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,744 DEBUG [RS:2;jenkins-hbase4:32791] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-26 07:01:08,744 DEBUG [RS:1;jenkins-hbase4:39873] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,744 DEBUG [RS:2;jenkins-hbase4:32791] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,744 DEBUG [RS:1;jenkins-hbase4:39873] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-26 07:01:08,744 DEBUG [RS:0;jenkins-hbase4:42373] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,744 DEBUG [RS:1;jenkins-hbase4:39873] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,744 DEBUG [RS:2;jenkins-hbase4:32791] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,744 DEBUG [RS:1;jenkins-hbase4:39873] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,744 DEBUG [RS:2;jenkins-hbase4:32791] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,745 DEBUG [RS:1;jenkins-hbase4:39873] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,744 DEBUG [RS:0;jenkins-hbase4:42373] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,745 DEBUG [RS:1;jenkins-hbase4:39873] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,745 DEBUG [RS:2;jenkins-hbase4:32791] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,745 DEBUG [RS:0;jenkins-hbase4:42373] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,745 DEBUG [RS:0;jenkins-hbase4:42373] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,746 DEBUG [RS:0;jenkins-hbase4:42373] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-26 07:01:08,746 DEBUG [RS:0;jenkins-hbase4:42373] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,746 DEBUG [RS:0;jenkins-hbase4:42373] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,746 DEBUG [RS:0;jenkins-hbase4:42373] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,747 DEBUG [RS:0;jenkins-hbase4:42373] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-26 07:01:08,749 INFO [RS:1;jenkins-hbase4:39873] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:08,749 INFO [RS:2;jenkins-hbase4:32791] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:08,750 INFO [RS:2;jenkins-hbase4:32791] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:08,749 INFO [RS:1;jenkins-hbase4:39873] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:08,750 INFO [RS:0;jenkins-hbase4:42373] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:08,750 INFO [RS:2;jenkins-hbase4:32791] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:08,750 INFO [RS:0;jenkins-hbase4:42373] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:08,750 INFO [RS:1;jenkins-hbase4:39873] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:08,750 INFO [RS:0;jenkins-hbase4:42373] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:08,768 INFO [RS:0;jenkins-hbase4:42373] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-26 07:01:08,768 INFO [RS:2;jenkins-hbase4:32791] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-26 07:01:08,768 INFO [RS:1;jenkins-hbase4:39873] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-26 07:01:08,772 INFO [RS:1;jenkins-hbase4:39873] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39873,1695711667206-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:08,772 INFO [RS:2;jenkins-hbase4:32791] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32791,1695711667250-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:08,772 INFO [RS:0;jenkins-hbase4:42373] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42373,1695711667152-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:08,791 INFO [RS:2;jenkins-hbase4:32791] regionserver.Replication(203): jenkins-hbase4.apache.org,32791,1695711667250 started 2023-09-26 07:01:08,791 INFO [RS:0;jenkins-hbase4:42373] regionserver.Replication(203): jenkins-hbase4.apache.org,42373,1695711667152 started 2023-09-26 07:01:08,791 INFO [RS:1;jenkins-hbase4:39873] regionserver.Replication(203): jenkins-hbase4.apache.org,39873,1695711667206 started 2023-09-26 07:01:08,792 INFO [RS:1;jenkins-hbase4:39873] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39873,1695711667206, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39873, sessionid=0x100e709d2ca0002 2023-09-26 07:01:08,792 DEBUG [RS:1;jenkins-hbase4:39873] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-26 07:01:08,791 INFO [RS:2;jenkins-hbase4:32791] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,32791,1695711667250, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:32791, sessionid=0x100e709d2ca0003 2023-09-26 07:01:08,792 DEBUG [RS:1;jenkins-hbase4:39873] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:08,792 INFO [RS:0;jenkins-hbase4:42373] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42373,1695711667152, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42373, sessionid=0x100e709d2ca0001 2023-09-26 07:01:08,792 DEBUG [RS:1;jenkins-hbase4:39873] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39873,1695711667206' 2023-09-26 07:01:08,792 DEBUG [RS:0;jenkins-hbase4:42373] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-26 07:01:08,792 DEBUG [RS:2;jenkins-hbase4:32791] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-26 07:01:08,793 DEBUG [RS:0;jenkins-hbase4:42373] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:08,792 DEBUG [RS:1;jenkins-hbase4:39873] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-26 07:01:08,793 DEBUG [RS:0;jenkins-hbase4:42373] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42373,1695711667152' 2023-09-26 07:01:08,794 DEBUG [RS:0;jenkins-hbase4:42373] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-26 07:01:08,793 DEBUG [RS:2;jenkins-hbase4:32791] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:08,794 DEBUG [RS:2;jenkins-hbase4:32791] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32791,1695711667250' 2023-09-26 07:01:08,795 DEBUG [RS:2;jenkins-hbase4:32791] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-26 07:01:08,795 DEBUG [RS:1;jenkins-hbase4:39873] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-26 07:01:08,795 DEBUG [RS:0;jenkins-hbase4:42373] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-26 07:01:08,795 DEBUG [RS:2;jenkins-hbase4:32791] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-26 07:01:08,796 DEBUG [RS:1;jenkins-hbase4:39873] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-26 07:01:08,796 DEBUG [RS:1;jenkins-hbase4:39873] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-26 07:01:08,796 DEBUG [RS:0;jenkins-hbase4:42373] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-26 07:01:08,796 DEBUG [RS:1;jenkins-hbase4:39873] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:08,796 DEBUG [RS:2;jenkins-hbase4:32791] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-26 07:01:08,796 DEBUG [RS:1;jenkins-hbase4:39873] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39873,1695711667206' 2023-09-26 07:01:08,796 DEBUG [RS:1;jenkins-hbase4:39873] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:08,796 DEBUG [RS:0;jenkins-hbase4:42373] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-26 07:01:08,796 DEBUG [RS:2;jenkins-hbase4:32791] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-26 07:01:08,797 DEBUG [RS:2;jenkins-hbase4:32791] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:08,796 DEBUG [RS:0;jenkins-hbase4:42373] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:08,797 DEBUG [RS:0;jenkins-hbase4:42373] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42373,1695711667152' 2023-09-26 07:01:08,797 DEBUG [RS:0;jenkins-hbase4:42373] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:08,797 DEBUG [RS:2;jenkins-hbase4:32791] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32791,1695711667250' 2023-09-26 07:01:08,797 DEBUG [RS:2;jenkins-hbase4:32791] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:08,797 DEBUG [RS:1;jenkins-hbase4:39873] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:08,798 DEBUG [RS:0;jenkins-hbase4:42373] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:08,799 DEBUG [RS:2;jenkins-hbase4:32791] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:08,799 DEBUG [RS:0;jenkins-hbase4:42373] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-26 07:01:08,799 DEBUG [RS:1;jenkins-hbase4:39873] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-26 07:01:08,799 INFO [RS:0;jenkins-hbase4:42373] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-26 07:01:08,799 INFO [RS:1;jenkins-hbase4:39873] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-26 07:01:08,800 DEBUG [RS:2;jenkins-hbase4:32791] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-26 07:01:08,800 INFO [RS:1;jenkins-hbase4:39873] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-26 07:01:08,800 INFO [RS:0;jenkins-hbase4:42373] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-26 07:01:08,801 INFO [RS:2;jenkins-hbase4:32791] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-26 07:01:08,801 INFO [RS:2;jenkins-hbase4:32791] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-26 07:01:08,817 DEBUG [jenkins-hbase4:38147] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-26 07:01:08,822 DEBUG [jenkins-hbase4:38147] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-26 07:01:08,828 DEBUG [jenkins-hbase4:38147] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-26 07:01:08,828 DEBUG [jenkins-hbase4:38147] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-26 07:01:08,828 DEBUG [jenkins-hbase4:38147] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-26 07:01:08,828 DEBUG [jenkins-hbase4:38147] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-26 07:01:08,831 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,32791,1695711667250, state=OPENING 2023-09-26 07:01:08,838 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-26 07:01:08,840 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-26 07:01:08,841 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-26 07:01:08,844 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,32791,1695711667250}] 2023-09-26 07:01:08,912 INFO [RS:0;jenkins-hbase4:42373] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42373%2C1695711667152, suffix=, logDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/WALs/jenkins-hbase4.apache.org,42373,1695711667152, archiveDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/oldWALs, maxLogs=32 2023-09-26 07:01:08,912 INFO [RS:2;jenkins-hbase4:32791] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32791%2C1695711667250, suffix=, logDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/WALs/jenkins-hbase4.apache.org,32791,1695711667250, archiveDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/oldWALs, maxLogs=32 2023-09-26 07:01:08,914 INFO [RS:1;jenkins-hbase4:39873] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39873%2C1695711667206, suffix=, logDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/WALs/jenkins-hbase4.apache.org,39873,1695711667206, archiveDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/oldWALs, maxLogs=32 2023-09-26 07:01:08,952 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36043,DS-4a2bab15-cb27-4e16-b652-3c48baf56230,DISK] 2023-09-26 07:01:08,952 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36043,DS-4a2bab15-cb27-4e16-b652-3c48baf56230,DISK] 2023-09-26 07:01:08,952 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39531,DS-da28763d-838c-4c86-9f74-e02f9cc8e4ae,DISK] 2023-09-26 07:01:08,953 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37323,DS-20c0ae80-c373-4cde-a6d4-8bd884bb903c,DISK] 2023-09-26 07:01:08,953 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39531,DS-da28763d-838c-4c86-9f74-e02f9cc8e4ae,DISK] 2023-09-26 07:01:08,953 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36043,DS-4a2bab15-cb27-4e16-b652-3c48baf56230,DISK] 2023-09-26 07:01:08,953 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37323,DS-20c0ae80-c373-4cde-a6d4-8bd884bb903c,DISK] 2023-09-26 07:01:08,953 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37323,DS-20c0ae80-c373-4cde-a6d4-8bd884bb903c,DISK] 2023-09-26 07:01:08,953 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39531,DS-da28763d-838c-4c86-9f74-e02f9cc8e4ae,DISK] 2023-09-26 07:01:08,965 INFO [RS:1;jenkins-hbase4:39873] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/WALs/jenkins-hbase4.apache.org,39873,1695711667206/jenkins-hbase4.apache.org%2C39873%2C1695711667206.1695711668918 2023-09-26 07:01:08,965 INFO [RS:2;jenkins-hbase4:32791] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/WALs/jenkins-hbase4.apache.org,32791,1695711667250/jenkins-hbase4.apache.org%2C32791%2C1695711667250.1695711668918 2023-09-26 07:01:08,965 INFO [RS:0;jenkins-hbase4:42373] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/WALs/jenkins-hbase4.apache.org,42373,1695711667152/jenkins-hbase4.apache.org%2C42373%2C1695711667152.1695711668918 2023-09-26 07:01:08,965 DEBUG [RS:1;jenkins-hbase4:39873] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36043,DS-4a2bab15-cb27-4e16-b652-3c48baf56230,DISK], DatanodeInfoWithStorage[127.0.0.1:37323,DS-20c0ae80-c373-4cde-a6d4-8bd884bb903c,DISK], DatanodeInfoWithStorage[127.0.0.1:39531,DS-da28763d-838c-4c86-9f74-e02f9cc8e4ae,DISK]] 2023-09-26 07:01:08,969 DEBUG [RS:2;jenkins-hbase4:32791] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39531,DS-da28763d-838c-4c86-9f74-e02f9cc8e4ae,DISK], DatanodeInfoWithStorage[127.0.0.1:37323,DS-20c0ae80-c373-4cde-a6d4-8bd884bb903c,DISK], DatanodeInfoWithStorage[127.0.0.1:36043,DS-4a2bab15-cb27-4e16-b652-3c48baf56230,DISK]] 2023-09-26 07:01:08,969 DEBUG [RS:0;jenkins-hbase4:42373] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36043,DS-4a2bab15-cb27-4e16-b652-3c48baf56230,DISK], DatanodeInfoWithStorage[127.0.0.1:39531,DS-da28763d-838c-4c86-9f74-e02f9cc8e4ae,DISK], DatanodeInfoWithStorage[127.0.0.1:37323,DS-20c0ae80-c373-4cde-a6d4-8bd884bb903c,DISK]] 2023-09-26 07:01:09,031 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:09,035 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-26 07:01:09,038 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54982, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-26 07:01:09,054 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-26 07:01:09,054 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-26 07:01:09,057 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32791%2C1695711667250.meta, suffix=.meta, logDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/WALs/jenkins-hbase4.apache.org,32791,1695711667250, archiveDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/oldWALs, maxLogs=32 2023-09-26 07:01:09,077 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37323,DS-20c0ae80-c373-4cde-a6d4-8bd884bb903c,DISK] 2023-09-26 07:01:09,077 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39531,DS-da28763d-838c-4c86-9f74-e02f9cc8e4ae,DISK] 2023-09-26 07:01:09,085 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36043,DS-4a2bab15-cb27-4e16-b652-3c48baf56230,DISK] 2023-09-26 07:01:09,095 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/WALs/jenkins-hbase4.apache.org,32791,1695711667250/jenkins-hbase4.apache.org%2C32791%2C1695711667250.meta.1695711669058.meta 2023-09-26 07:01:09,097 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37323,DS-20c0ae80-c373-4cde-a6d4-8bd884bb903c,DISK], DatanodeInfoWithStorage[127.0.0.1:39531,DS-da28763d-838c-4c86-9f74-e02f9cc8e4ae,DISK], DatanodeInfoWithStorage[127.0.0.1:36043,DS-4a2bab15-cb27-4e16-b652-3c48baf56230,DISK]] 2023-09-26 07:01:09,097 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-26 07:01:09,098 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-26 07:01:09,100 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 07:01:09,101 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-26 07:01:09,103 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-26 07:01:09,104 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-26 07:01:09,119 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-26 07:01:09,119 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:01:09,119 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-26 07:01:09,119 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-26 07:01:09,125 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-26 07:01:09,127 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740/info 2023-09-26 07:01:09,127 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740/info 2023-09-26 07:01:09,128 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-26 07:01:09,129 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:01:09,129 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-26 07:01:09,131 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740/rep_barrier 2023-09-26 07:01:09,131 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740/rep_barrier 2023-09-26 07:01:09,132 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-26 07:01:09,133 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:01:09,133 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-26 07:01:09,135 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740/table 2023-09-26 07:01:09,135 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740/table 2023-09-26 07:01:09,135 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-26 07:01:09,136 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:01:09,141 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740 2023-09-26 07:01:09,144 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740 2023-09-26 07:01:09,148 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-26 07:01:09,150 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-26 07:01:09,152 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63511414, jitterRate=-0.05360618233680725}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-26 07:01:09,154 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-26 07:01:09,165 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695711669023 2023-09-26 07:01:09,184 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-26 07:01:09,185 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-26 07:01:09,185 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,32791,1695711667250, state=OPEN 2023-09-26 07:01:09,195 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-26 07:01:09,195 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-26 07:01:09,199 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-26 07:01:09,200 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,32791,1695711667250 in 351 msec 2023-09-26 07:01:09,207 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-26 07:01:09,207 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 567 msec 2023-09-26 07:01:09,215 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 816 msec 2023-09-26 07:01:09,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695711669215, completionTime=-1 2023-09-26 07:01:09,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-26 07:01:09,215 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-26 07:01:09,282 DEBUG [hconnection-0x354067f6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:09,285 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:01:09,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-26 07:01:09,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695711729318 2023-09-26 07:01:09,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695711789319 2023-09-26 07:01:09,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 103 msec 2023-09-26 07:01:09,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38147,1695711665890-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:09,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38147,1695711665890-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:09,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38147,1695711665890-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:09,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38147, period=300000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:09,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-26 07:01:09,353 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-26 07:01:09,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-26 07:01:09,368 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-26 07:01:09,382 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-26 07:01:09,384 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-26 07:01:09,387 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-26 07:01:09,417 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/hbase/namespace/5f9d9a63d6b0e101954a6975eabb7425 2023-09-26 07:01:09,421 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/hbase/namespace/5f9d9a63d6b0e101954a6975eabb7425 empty. 2023-09-26 07:01:09,422 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/hbase/namespace/5f9d9a63d6b0e101954a6975eabb7425 2023-09-26 07:01:09,422 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-26 07:01:09,462 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-26 07:01:09,465 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5f9d9a63d6b0e101954a6975eabb7425, NAME => 'hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp 2023-09-26 07:01:09,484 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:01:09,484 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 5f9d9a63d6b0e101954a6975eabb7425, disabling compactions & flushes 2023-09-26 07:01:09,484 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425. 2023-09-26 07:01:09,484 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425. 2023-09-26 07:01:09,484 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425. after waiting 0 ms 2023-09-26 07:01:09,484 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425. 2023-09-26 07:01:09,484 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425. 2023-09-26 07:01:09,484 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 5f9d9a63d6b0e101954a6975eabb7425: 2023-09-26 07:01:09,488 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-26 07:01:09,505 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695711669491"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711669491"}]},"ts":"1695711669491"} 2023-09-26 07:01:09,534 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-26 07:01:09,536 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-26 07:01:09,540 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711669536"}]},"ts":"1695711669536"} 2023-09-26 07:01:09,544 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-26 07:01:09,549 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-26 07:01:09,551 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-26 07:01:09,551 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-26 07:01:09,551 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-26 07:01:09,551 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-26 07:01:09,557 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5f9d9a63d6b0e101954a6975eabb7425, ASSIGN}] 2023-09-26 07:01:09,560 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5f9d9a63d6b0e101954a6975eabb7425, ASSIGN 2023-09-26 07:01:09,562 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=5f9d9a63d6b0e101954a6975eabb7425, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39873,1695711667206; forceNewPlan=false, retain=false 2023-09-26 07:01:09,714 INFO [jenkins-hbase4:38147] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-26 07:01:09,715 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5f9d9a63d6b0e101954a6975eabb7425, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:09,716 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695711669715"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711669715"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711669715"}]},"ts":"1695711669715"} 2023-09-26 07:01:09,720 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 5f9d9a63d6b0e101954a6975eabb7425, server=jenkins-hbase4.apache.org,39873,1695711667206}] 2023-09-26 07:01:09,875 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:09,875 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-26 07:01:09,879 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59458, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-26 07:01:09,885 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425. 2023-09-26 07:01:09,885 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5f9d9a63d6b0e101954a6975eabb7425, NAME => 'hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425.', STARTKEY => '', ENDKEY => ''} 2023-09-26 07:01:09,886 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425. service=AccessControlService 2023-09-26 07:01:09,886 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 07:01:09,887 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 5f9d9a63d6b0e101954a6975eabb7425 2023-09-26 07:01:09,887 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:01:09,887 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5f9d9a63d6b0e101954a6975eabb7425 2023-09-26 07:01:09,887 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5f9d9a63d6b0e101954a6975eabb7425 2023-09-26 07:01:09,890 INFO [StoreOpener-5f9d9a63d6b0e101954a6975eabb7425-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 5f9d9a63d6b0e101954a6975eabb7425 2023-09-26 07:01:09,892 DEBUG [StoreOpener-5f9d9a63d6b0e101954a6975eabb7425-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/namespace/5f9d9a63d6b0e101954a6975eabb7425/info 2023-09-26 07:01:09,892 DEBUG [StoreOpener-5f9d9a63d6b0e101954a6975eabb7425-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/namespace/5f9d9a63d6b0e101954a6975eabb7425/info 2023-09-26 07:01:09,892 INFO [StoreOpener-5f9d9a63d6b0e101954a6975eabb7425-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f9d9a63d6b0e101954a6975eabb7425 columnFamilyName info 2023-09-26 07:01:09,893 INFO [StoreOpener-5f9d9a63d6b0e101954a6975eabb7425-1] regionserver.HStore(310): Store=5f9d9a63d6b0e101954a6975eabb7425/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:01:09,895 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/namespace/5f9d9a63d6b0e101954a6975eabb7425 2023-09-26 07:01:09,896 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/namespace/5f9d9a63d6b0e101954a6975eabb7425 2023-09-26 07:01:09,900 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5f9d9a63d6b0e101954a6975eabb7425 2023-09-26 07:01:09,904 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/namespace/5f9d9a63d6b0e101954a6975eabb7425/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 07:01:09,905 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5f9d9a63d6b0e101954a6975eabb7425; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63770111, jitterRate=-0.049751296639442444}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 07:01:09,905 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5f9d9a63d6b0e101954a6975eabb7425: 2023-09-26 07:01:09,907 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425., pid=6, masterSystemTime=1695711669875 2023-09-26 07:01:09,912 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425. 2023-09-26 07:01:09,912 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425. 2023-09-26 07:01:09,914 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5f9d9a63d6b0e101954a6975eabb7425, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:09,915 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695711669913"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695711669913"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695711669913"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695711669913"}]},"ts":"1695711669913"} 2023-09-26 07:01:09,922 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-26 07:01:09,922 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 5f9d9a63d6b0e101954a6975eabb7425, server=jenkins-hbase4.apache.org,39873,1695711667206 in 198 msec 2023-09-26 07:01:09,926 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-26 07:01:09,927 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=5f9d9a63d6b0e101954a6975eabb7425, ASSIGN in 365 msec 2023-09-26 07:01:09,928 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-26 07:01:09,928 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711669928"}]},"ts":"1695711669928"} 2023-09-26 07:01:09,931 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-26 07:01:09,935 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-26 07:01:09,938 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 565 msec 2023-09-26 07:01:09,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-26 07:01:09,987 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-26 07:01:09,987 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-26 07:01:10,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:10,014 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:01:10,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-26 07:01:10,051 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-26 07:01:10,059 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 37 msec 2023-09-26 07:01:10,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-26 07:01:10,075 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-26 07:01:10,081 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2023-09-26 07:01:10,092 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-26 07:01:10,094 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-26 07:01:10,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.780sec 2023-09-26 07:01:10,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-26 07:01:10,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-26 07:01:10,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-26 07:01:10,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38147,1695711665890-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-26 07:01:10,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38147,1695711665890-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-26 07:01:10,124 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-26 07:01:10,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-26 07:01:10,128 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-26 07:01:10,130 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-26 07:01:10,132 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-26 07:01:10,133 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/hbase/acl/bb54fa38fdc696cab3c00cf554adfe8d 2023-09-26 07:01:10,134 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/hbase/acl/bb54fa38fdc696cab3c00cf554adfe8d empty. 2023-09-26 07:01:10,138 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/hbase/acl/bb54fa38fdc696cab3c00cf554adfe8d 2023-09-26 07:01:10,138 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-26 07:01:10,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-26 07:01:10,160 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-26 07:01:10,162 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => bb54fa38fdc696cab3c00cf554adfe8d, NAME => 'hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp 2023-09-26 07:01:10,183 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:01:10,184 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing bb54fa38fdc696cab3c00cf554adfe8d, disabling compactions & flushes 2023-09-26 07:01:10,184 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d. 2023-09-26 07:01:10,184 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d. 2023-09-26 07:01:10,184 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d. after waiting 0 ms 2023-09-26 07:01:10,184 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d. 2023-09-26 07:01:10,184 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d. 2023-09-26 07:01:10,184 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for bb54fa38fdc696cab3c00cf554adfe8d: 2023-09-26 07:01:10,186 DEBUG [Listener at localhost/33837] zookeeper.ReadOnlyZKClient(139): Connect 0x2ac64c89 to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:01:10,190 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-26 07:01:10,192 DEBUG [Listener at localhost/33837] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ef1d215, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:01:10,192 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695711670192"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711670192"}]},"ts":"1695711670192"} 2023-09-26 07:01:10,196 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-26 07:01:10,198 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-26 07:01:10,198 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711670198"}]},"ts":"1695711670198"} 2023-09-26 07:01:10,202 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-26 07:01:10,210 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-26 07:01:10,211 DEBUG [hconnection-0x2a1b6401-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:10,212 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-26 07:01:10,212 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-26 07:01:10,212 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-26 07:01:10,212 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-26 07:01:10,212 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=bb54fa38fdc696cab3c00cf554adfe8d, ASSIGN}] 2023-09-26 07:01:10,215 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=bb54fa38fdc696cab3c00cf554adfe8d, ASSIGN 2023-09-26 07:01:10,216 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=bb54fa38fdc696cab3c00cf554adfe8d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39873,1695711667206; forceNewPlan=false, retain=false 2023-09-26 07:01:10,229 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54992, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:01:10,232 INFO [Listener at localhost/33837] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38147,1695711665890 2023-09-26 07:01:10,233 INFO [Listener at localhost/33837] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-26 07:01:10,233 INFO [Listener at localhost/33837] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/test.cache.data in system properties and HBase conf 2023-09-26 07:01:10,233 INFO [Listener at localhost/33837] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/hadoop.tmp.dir in system properties and HBase conf 2023-09-26 07:01:10,233 INFO [Listener at localhost/33837] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/hadoop.log.dir in system properties and HBase conf 2023-09-26 07:01:10,233 INFO [Listener at localhost/33837] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-26 07:01:10,233 INFO [Listener at localhost/33837] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-26 07:01:10,233 INFO [Listener at localhost/33837] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-26 07:01:10,233 INFO [Listener at localhost/33837] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-26 07:01:10,233 INFO [Listener at localhost/33837] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-26 07:01:10,234 INFO [Listener at localhost/33837] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-26 07:01:10,234 INFO [Listener at localhost/33837] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-26 07:01:10,234 INFO [Listener at localhost/33837] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-26 07:01:10,234 INFO [Listener at localhost/33837] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-26 07:01:10,234 INFO [Listener at localhost/33837] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-26 07:01:10,234 INFO [Listener at localhost/33837] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-26 07:01:10,234 INFO [Listener at localhost/33837] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-26 07:01:10,234 INFO [Listener at localhost/33837] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/nfs.dump.dir in system properties and HBase conf 2023-09-26 07:01:10,234 INFO [Listener at localhost/33837] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/java.io.tmpdir in system properties and HBase conf 2023-09-26 07:01:10,234 INFO [Listener at localhost/33837] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-26 07:01:10,234 INFO [Listener at localhost/33837] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-26 07:01:10,234 INFO [Listener at localhost/33837] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-26 07:01:10,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-26 07:01:10,366 INFO [jenkins-hbase4:38147] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-26 07:01:10,367 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=bb54fa38fdc696cab3c00cf554adfe8d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:10,368 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695711670367"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711670367"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711670367"}]},"ts":"1695711670367"} 2023-09-26 07:01:10,371 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure bb54fa38fdc696cab3c00cf554adfe8d, server=jenkins-hbase4.apache.org,39873,1695711667206}] 2023-09-26 07:01:10,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-26 07:01:10,532 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d. 2023-09-26 07:01:10,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bb54fa38fdc696cab3c00cf554adfe8d, NAME => 'hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d.', STARTKEY => '', ENDKEY => ''} 2023-09-26 07:01:10,533 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d. service=AccessControlService 2023-09-26 07:01:10,534 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 07:01:10,534 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl bb54fa38fdc696cab3c00cf554adfe8d 2023-09-26 07:01:10,534 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:01:10,534 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bb54fa38fdc696cab3c00cf554adfe8d 2023-09-26 07:01:10,534 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bb54fa38fdc696cab3c00cf554adfe8d 2023-09-26 07:01:10,537 INFO [StoreOpener-bb54fa38fdc696cab3c00cf554adfe8d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region bb54fa38fdc696cab3c00cf554adfe8d 2023-09-26 07:01:10,539 DEBUG [StoreOpener-bb54fa38fdc696cab3c00cf554adfe8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/acl/bb54fa38fdc696cab3c00cf554adfe8d/l 2023-09-26 07:01:10,539 DEBUG [StoreOpener-bb54fa38fdc696cab3c00cf554adfe8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/acl/bb54fa38fdc696cab3c00cf554adfe8d/l 2023-09-26 07:01:10,540 INFO [StoreOpener-bb54fa38fdc696cab3c00cf554adfe8d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb54fa38fdc696cab3c00cf554adfe8d columnFamilyName l 2023-09-26 07:01:10,541 INFO [StoreOpener-bb54fa38fdc696cab3c00cf554adfe8d-1] regionserver.HStore(310): Store=bb54fa38fdc696cab3c00cf554adfe8d/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:01:10,543 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/acl/bb54fa38fdc696cab3c00cf554adfe8d 2023-09-26 07:01:10,545 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/acl/bb54fa38fdc696cab3c00cf554adfe8d 2023-09-26 07:01:10,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bb54fa38fdc696cab3c00cf554adfe8d 2023-09-26 07:01:10,556 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/acl/bb54fa38fdc696cab3c00cf554adfe8d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 07:01:10,557 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bb54fa38fdc696cab3c00cf554adfe8d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63713548, jitterRate=-0.05059415102005005}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 07:01:10,558 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bb54fa38fdc696cab3c00cf554adfe8d: 2023-09-26 07:01:10,559 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d., pid=11, masterSystemTime=1695711670525 2023-09-26 07:01:10,573 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d. 2023-09-26 07:01:10,573 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d. 2023-09-26 07:01:10,574 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=bb54fa38fdc696cab3c00cf554adfe8d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:10,574 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695711670574"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695711670574"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695711670574"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695711670574"}]},"ts":"1695711670574"} 2023-09-26 07:01:10,590 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-26 07:01:10,590 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure bb54fa38fdc696cab3c00cf554adfe8d, server=jenkins-hbase4.apache.org,39873,1695711667206 in 215 msec 2023-09-26 07:01:10,594 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-26 07:01:10,594 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=bb54fa38fdc696cab3c00cf554adfe8d, ASSIGN in 378 msec 2023-09-26 07:01:10,595 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-26 07:01:10,595 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711670595"}]},"ts":"1695711670595"} 2023-09-26 07:01:10,598 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-26 07:01:10,602 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-26 07:01:10,604 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 478 msec 2023-09-26 07:01:10,747 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-26 07:01:10,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-26 07:01:10,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-26 07:01:11,491 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-26 07:01:11,901 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-09-26 07:01:11,908 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44189_jobhistory____om2k9n/webapp 2023-09-26 07:01:12,089 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-26 07:01:12,089 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-26 07:01:12,089 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-26 07:01:12,093 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-26 07:01:12,182 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-26 07:01:12,517 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-26 07:01:12,779 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-26 07:01:12,810 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44189 2023-09-26 07:01:12,984 WARN [Listener at jenkins-hbase4.apache.org/40629] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-26 07:01:13,273 WARN [Listener at jenkins-hbase4.apache.org/40629] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-26 07:01:13,274 INFO [Listener at jenkins-hbase4.apache.org/40629] log.Slf4jLog(67): jetty-6.1.26 2023-09-26 07:01:13,284 INFO [Listener at jenkins-hbase4.apache.org/40629] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37803_cluster____iap4vh/webapp 2023-09-26 07:01:13,363 INFO [Listener at jenkins-hbase4.apache.org/40629] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-26 07:01:13,363 INFO [Listener at jenkins-hbase4.apache.org/40629] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-26 07:01:13,363 INFO [Listener at jenkins-hbase4.apache.org/40629] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-26 07:01:13,363 INFO [Listener at jenkins-hbase4.apache.org/40629] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-26 07:01:13,373 INFO [Listener at jenkins-hbase4.apache.org/40629] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-26 07:01:13,557 INFO [Listener at jenkins-hbase4.apache.org/40629] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-26 07:01:13,640 INFO [Listener at jenkins-hbase4.apache.org/40629] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-26 07:01:13,647 INFO [Listener at jenkins-hbase4.apache.org/40629] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37803 2023-09-26 07:01:14,128 WARN [Listener at jenkins-hbase4.apache.org/39903] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-26 07:01:14,198 WARN [Listener at jenkins-hbase4.apache.org/39903] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-26 07:01:14,198 INFO [Listener at jenkins-hbase4.apache.org/39903] log.Slf4jLog(67): jetty-6.1.26 2023-09-26 07:01:14,208 INFO [Listener at jenkins-hbase4.apache.org/39903] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40561_node____.92p6vi/webapp 2023-09-26 07:01:14,266 INFO [Listener at jenkins-hbase4.apache.org/39903] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-26 07:01:14,266 INFO [Listener at jenkins-hbase4.apache.org/39903] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-26 07:01:14,266 INFO [Listener at jenkins-hbase4.apache.org/39903] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-26 07:01:14,267 INFO [Listener at jenkins-hbase4.apache.org/39903] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-26 07:01:14,277 INFO [Listener at jenkins-hbase4.apache.org/39903] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-26 07:01:14,298 INFO [Listener at jenkins-hbase4.apache.org/39903] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-26 07:01:14,363 INFO [Listener at jenkins-hbase4.apache.org/39903] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-26 07:01:14,373 INFO [Listener at jenkins-hbase4.apache.org/39903] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40561 2023-09-26 07:01:14,556 WARN [Listener at jenkins-hbase4.apache.org/41375] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-26 07:01:14,564 WARN [Listener at jenkins-hbase4.apache.org/41375] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-26 07:01:14,565 INFO [Listener at jenkins-hbase4.apache.org/41375] log.Slf4jLog(67): jetty-6.1.26 2023-09-26 07:01:14,572 INFO [Listener at jenkins-hbase4.apache.org/41375] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34911_node____.r9xiga/webapp 2023-09-26 07:01:14,624 INFO [Listener at jenkins-hbase4.apache.org/41375] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-26 07:01:14,624 INFO [Listener at jenkins-hbase4.apache.org/41375] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-26 07:01:14,624 INFO [Listener at jenkins-hbase4.apache.org/41375] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-26 07:01:14,624 INFO [Listener at jenkins-hbase4.apache.org/41375] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-26 07:01:14,635 INFO [Listener at jenkins-hbase4.apache.org/41375] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-26 07:01:14,651 INFO [Listener at jenkins-hbase4.apache.org/41375] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-26 07:01:14,676 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-26 07:01:14,782 INFO [Listener at jenkins-hbase4.apache.org/41375] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-26 07:01:14,793 INFO [Listener at jenkins-hbase4.apache.org/41375] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34911 2023-09-26 07:01:14,822 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-26 07:01:14,824 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 07:01:14,910 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=200, ProcessCount=165, AvailableMemoryMB=5449 2023-09-26 07:01:14,911 WARN [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-09-26 07:01:14,926 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-26 07:01:14,928 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-26 07:01:14,928 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-26 07:01:14,931 DEBUG [Listener at jenkins-hbase4.apache.org/41375] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-26 07:01:14,937 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-26 07:01:14,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-26 07:01:14,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-26 07:01:14,950 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-26 07:01:14,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-26 07:01:14,954 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-26 07:01:14,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-26 07:01:14,959 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportWithTargetName/ba04b02f9e59516b15829d22adb73fac 2023-09-26 07:01:14,959 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportWithTargetName/882bdb7634d941ac8443760e3dcafbf0 2023-09-26 07:01:14,963 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportWithTargetName/ba04b02f9e59516b15829d22adb73fac empty. 2023-09-26 07:01:14,963 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportWithTargetName/882bdb7634d941ac8443760e3dcafbf0 empty. 2023-09-26 07:01:14,964 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportWithTargetName/ba04b02f9e59516b15829d22adb73fac 2023-09-26 07:01:14,965 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportWithTargetName/882bdb7634d941ac8443760e3dcafbf0 2023-09-26 07:01:14,965 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-26 07:01:14,996 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-26 07:01:14,998 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 882bdb7634d941ac8443760e3dcafbf0, NAME => 'testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp 2023-09-26 07:01:14,998 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => ba04b02f9e59516b15829d22adb73fac, NAME => 'testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp 2023-09-26 07:01:15,033 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:01:15,034 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:01:15,035 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 882bdb7634d941ac8443760e3dcafbf0, disabling compactions & flushes 2023-09-26 07:01:15,035 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing ba04b02f9e59516b15829d22adb73fac, disabling compactions & flushes 2023-09-26 07:01:15,035 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0. 2023-09-26 07:01:15,035 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. 2023-09-26 07:01:15,035 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0. 2023-09-26 07:01:15,035 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. 2023-09-26 07:01:15,035 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0. after waiting 0 ms 2023-09-26 07:01:15,036 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. after waiting 0 ms 2023-09-26 07:01:15,036 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0. 2023-09-26 07:01:15,036 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. 2023-09-26 07:01:15,036 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0. 2023-09-26 07:01:15,036 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. 2023-09-26 07:01:15,036 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 882bdb7634d941ac8443760e3dcafbf0: 2023-09-26 07:01:15,036 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for ba04b02f9e59516b15829d22adb73fac: 2023-09-26 07:01:15,040 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-26 07:01:15,041 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695711675041"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711675041"}]},"ts":"1695711675041"} 2023-09-26 07:01:15,041 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695711675041"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711675041"}]},"ts":"1695711675041"} 2023-09-26 07:01:15,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-26 07:01:15,096 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-26 07:01:15,098 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-26 07:01:15,098 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711675098"}]},"ts":"1695711675098"} 2023-09-26 07:01:15,101 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-26 07:01:15,106 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-26 07:01:15,108 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-26 07:01:15,108 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-26 07:01:15,108 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-26 07:01:15,108 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-26 07:01:15,109 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ba04b02f9e59516b15829d22adb73fac, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=882bdb7634d941ac8443760e3dcafbf0, ASSIGN}] 2023-09-26 07:01:15,112 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=882bdb7634d941ac8443760e3dcafbf0, ASSIGN 2023-09-26 07:01:15,112 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ba04b02f9e59516b15829d22adb73fac, ASSIGN 2023-09-26 07:01:15,114 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=882bdb7634d941ac8443760e3dcafbf0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39873,1695711667206; forceNewPlan=false, retain=false 2023-09-26 07:01:15,114 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ba04b02f9e59516b15829d22adb73fac, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42373,1695711667152; forceNewPlan=false, retain=false 2023-09-26 07:01:15,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-26 07:01:15,264 INFO [jenkins-hbase4:38147] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-26 07:01:15,266 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=882bdb7634d941ac8443760e3dcafbf0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:15,266 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ba04b02f9e59516b15829d22adb73fac, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:15,267 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695711675266"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711675266"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711675266"}]},"ts":"1695711675266"} 2023-09-26 07:01:15,267 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695711675266"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711675266"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711675266"}]},"ts":"1695711675266"} 2023-09-26 07:01:15,270 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 882bdb7634d941ac8443760e3dcafbf0, server=jenkins-hbase4.apache.org,39873,1695711667206}] 2023-09-26 07:01:15,271 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure ba04b02f9e59516b15829d22adb73fac, server=jenkins-hbase4.apache.org,42373,1695711667152}] 2023-09-26 07:01:15,426 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:15,426 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-26 07:01:15,430 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48992, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-26 07:01:15,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0. 2023-09-26 07:01:15,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 882bdb7634d941ac8443760e3dcafbf0, NAME => 'testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0.', STARTKEY => '1', ENDKEY => ''} 2023-09-26 07:01:15,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0. service=AccessControlService 2023-09-26 07:01:15,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 07:01:15,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 882bdb7634d941ac8443760e3dcafbf0 2023-09-26 07:01:15,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:01:15,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 882bdb7634d941ac8443760e3dcafbf0 2023-09-26 07:01:15,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 882bdb7634d941ac8443760e3dcafbf0 2023-09-26 07:01:15,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. 2023-09-26 07:01:15,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ba04b02f9e59516b15829d22adb73fac, NAME => 'testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac.', STARTKEY => '', ENDKEY => '1'} 2023-09-26 07:01:15,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. service=AccessControlService 2023-09-26 07:01:15,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 07:01:15,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName ba04b02f9e59516b15829d22adb73fac 2023-09-26 07:01:15,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:01:15,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ba04b02f9e59516b15829d22adb73fac 2023-09-26 07:01:15,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ba04b02f9e59516b15829d22adb73fac 2023-09-26 07:01:15,446 INFO [StoreOpener-882bdb7634d941ac8443760e3dcafbf0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 882bdb7634d941ac8443760e3dcafbf0 2023-09-26 07:01:15,446 INFO [StoreOpener-ba04b02f9e59516b15829d22adb73fac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ba04b02f9e59516b15829d22adb73fac 2023-09-26 07:01:15,448 DEBUG [StoreOpener-882bdb7634d941ac8443760e3dcafbf0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/882bdb7634d941ac8443760e3dcafbf0/cf 2023-09-26 07:01:15,448 DEBUG [StoreOpener-882bdb7634d941ac8443760e3dcafbf0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/882bdb7634d941ac8443760e3dcafbf0/cf 2023-09-26 07:01:15,448 DEBUG [StoreOpener-ba04b02f9e59516b15829d22adb73fac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/ba04b02f9e59516b15829d22adb73fac/cf 2023-09-26 07:01:15,448 DEBUG [StoreOpener-ba04b02f9e59516b15829d22adb73fac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/ba04b02f9e59516b15829d22adb73fac/cf 2023-09-26 07:01:15,452 INFO [StoreOpener-882bdb7634d941ac8443760e3dcafbf0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 882bdb7634d941ac8443760e3dcafbf0 columnFamilyName cf 2023-09-26 07:01:15,452 INFO [StoreOpener-ba04b02f9e59516b15829d22adb73fac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba04b02f9e59516b15829d22adb73fac columnFamilyName cf 2023-09-26 07:01:15,455 INFO [StoreOpener-882bdb7634d941ac8443760e3dcafbf0-1] regionserver.HStore(310): Store=882bdb7634d941ac8443760e3dcafbf0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:01:15,455 INFO [StoreOpener-ba04b02f9e59516b15829d22adb73fac-1] regionserver.HStore(310): Store=ba04b02f9e59516b15829d22adb73fac/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:01:15,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/882bdb7634d941ac8443760e3dcafbf0 2023-09-26 07:01:15,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/ba04b02f9e59516b15829d22adb73fac 2023-09-26 07:01:15,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/882bdb7634d941ac8443760e3dcafbf0 2023-09-26 07:01:15,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/ba04b02f9e59516b15829d22adb73fac 2023-09-26 07:01:15,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ba04b02f9e59516b15829d22adb73fac 2023-09-26 07:01:15,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 882bdb7634d941ac8443760e3dcafbf0 2023-09-26 07:01:15,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/882bdb7634d941ac8443760e3dcafbf0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 07:01:15,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/ba04b02f9e59516b15829d22adb73fac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 07:01:15,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ba04b02f9e59516b15829d22adb73fac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68289858, jitterRate=0.01759818196296692}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 07:01:15,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 882bdb7634d941ac8443760e3dcafbf0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71159986, jitterRate=0.060366421937942505}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 07:01:15,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ba04b02f9e59516b15829d22adb73fac: 2023-09-26 07:01:15,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 882bdb7634d941ac8443760e3dcafbf0: 2023-09-26 07:01:15,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0., pid=15, masterSystemTime=1695711675422 2023-09-26 07:01:15,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac., pid=16, masterSystemTime=1695711675426 2023-09-26 07:01:15,490 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=882bdb7634d941ac8443760e3dcafbf0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:15,491 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695711675490"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695711675490"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695711675490"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695711675490"}]},"ts":"1695711675490"} 2023-09-26 07:01:15,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. 2023-09-26 07:01:15,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0. 2023-09-26 07:01:15,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0. 2023-09-26 07:01:15,493 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. 2023-09-26 07:01:15,495 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ba04b02f9e59516b15829d22adb73fac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:15,495 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695711675495"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695711675495"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695711675495"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695711675495"}]},"ts":"1695711675495"} 2023-09-26 07:01:15,501 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-09-26 07:01:15,501 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 882bdb7634d941ac8443760e3dcafbf0, server=jenkins-hbase4.apache.org,39873,1695711667206 in 228 msec 2023-09-26 07:01:15,504 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-09-26 07:01:15,504 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=882bdb7634d941ac8443760e3dcafbf0, ASSIGN in 392 msec 2023-09-26 07:01:15,509 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure ba04b02f9e59516b15829d22adb73fac, server=jenkins-hbase4.apache.org,42373,1695711667152 in 228 msec 2023-09-26 07:01:15,515 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-26 07:01:15,515 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ba04b02f9e59516b15829d22adb73fac, ASSIGN in 395 msec 2023-09-26 07:01:15,516 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-26 07:01:15,516 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711675516"}]},"ts":"1695711675516"} 2023-09-26 07:01:15,518 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-26 07:01:15,522 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-26 07:01:15,529 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-26 07:01:15,540 DEBUG [hconnection-0x1c1fda0a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:15,544 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-09-26 07:01:15,555 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39873] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-26 07:01:15,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-26 07:01:15,592 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-26 07:01:15,592 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-26 07:01:15,592 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-26 07:01:15,592 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-26 07:01:15,592 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-26 07:01:15,600 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-26 07:01:15,600 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-26 07:01:15,600 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-26 07:01:15,600 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-26 07:01:15,604 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 656 msec 2023-09-26 07:01:16,056 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:01:16,057 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-26 07:01:16,057 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:01:16,057 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-26 07:01:16,058 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-26 07:01:16,058 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-26 07:01:16,058 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:01:16,058 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-26 07:01:16,058 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-26 07:01:16,058 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-26 07:01:16,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-26 07:01:16,065 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-26 07:01:16,070 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-26 07:01:16,071 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. 2023-09-26 07:01:16,074 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 07:01:16,106 DEBUG [hconnection-0x2a1b6401-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:16,111 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:01:16,115 DEBUG [hconnection-0x2a1b6401-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:16,118 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39246, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:01:16,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-26 07:01:16,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695711676134 (current time:1695711676134). 2023-09-26 07:01:16,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 07:01:16,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x1fd053c0 to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:01:16,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b264b81, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:01:16,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:16,147 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:01:16,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fd053c0 to 127.0.0.1:50261 2023-09-26 07:01:16,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:01:16,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x6a12523e to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:01:16,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f66e143, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:01:16,161 DEBUG [hconnection-0x297d3b7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:16,163 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54246, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:01:16,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:16,170 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:01:16,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a12523e to 127.0.0.1:50261 2023-09-26 07:01:16,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:01:16,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-26 07:01:16,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 07:01:16,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-26 07:01:16,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-26 07:01:16,223 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-26 07:01:16,224 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695712276224 2023-09-26 07:01:16,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-26 07:01:16,224 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-26 07:01:16,228 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-26 07:01:16,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-26 07:01:16,230 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-09-26 07:01:16,231 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-26 07:01:16,232 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695712276232 2023-09-26 07:01:16,233 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 07:01:16,233 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 07:01:16,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,263 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-26 07:01:16,264 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:16,265 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-26 07:01:16,265 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-26 07:01:16,266 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,266 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,272 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:16,272 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:16,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:16,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:16,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:16,272 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:16,272 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:16,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:16,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:16,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:16,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,273 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:16,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,273 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:16,274 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,274 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,274 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:16,274 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,274 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 07:01:16,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-26 07:01:16,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-26 07:01:16,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-26 07:01:16,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,276 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-26 07:01:16,276 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-26 07:01:16,276 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-26 07:01:16,282 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,283 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,283 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,283 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-26 07:01:16,283 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-26 07:01:16,283 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:16,283 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:16,283 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-26 07:01:16,284 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-26 07:01:16,285 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:16,284 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-26 07:01:16,285 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-26 07:01:16,285 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-26 07:01:16,285 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-26 07:01:16,285 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32791,1695711667250' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-26 07:01:16,285 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-26 07:01:16,285 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42373,1695711667152' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-26 07:01:16,286 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39873,1695711667206' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-26 07:01:16,288 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,288 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,288 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:16,288 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:16,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:16,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:16,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:16,289 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,289 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:16,289 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:01:16,289 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,289 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:01:16,289 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,289 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:01:16,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:16,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:16,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:16,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:16,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:16,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39873,1695711667206' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-26 07:01:16,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@150c5475[Count = 1] remaining members to acquire global barrier 2023-09-26 07:01:16,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:16,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:16,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:16,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:16,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:16,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:16,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:16,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:16,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:16,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42373,1695711667152' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-26 07:01:16,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@150c5475[Count = 0] remaining members to acquire global barrier 2023-09-26 07:01:16,295 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-26 07:01:16,295 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,297 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,297 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,297 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,297 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-26 07:01:16,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,297 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:16,297 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-26 07:01:16,297 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-26 07:01:16,298 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-26 07:01:16,298 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,32791,1695711667250' in zk 2023-09-26 07:01:16,298 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:16,298 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 07:01:16,298 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:01:16,298 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:01:16,298 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0. 2023-09-26 07:01:16,298 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. 2023-09-26 07:01:16,298 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:01:16,298 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:01:16,299 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0. started... 2023-09-26 07:01:16,299 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. started... 2023-09-26 07:01:16,302 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-26 07:01:16,302 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:16,302 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-26 07:01:16,304 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 882bdb7634d941ac8443760e3dcafbf0: 2023-09-26 07:01:16,304 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ba04b02f9e59516b15829d22adb73fac: 2023-09-26 07:01:16,305 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,305 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,310 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:01:16,310 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:01:16,314 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 07:01:16,314 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 07:01:16,335 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:01:16,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-26 07:01:16,345 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0. completed. 2023-09-26 07:01:16,345 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0. 2023-09-26 07:01:16,346 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:01:16,346 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:01:16,346 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:16,346 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-26 07:01:16,346 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39873,1695711667206' in zk 2023-09-26 07:01:16,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-26 07:01:16,347 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 07:01:16,349 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-26 07:01:16,349 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:16,349 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:16,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:16,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:16,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:16,349 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-26 07:01:16,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:16,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:16,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:16,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:16,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:16,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:16,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:16,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:16,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39873,1695711667206': 2023-09-26 07:01:16,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39873,1695711667206' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-26 07:01:16,547 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:01:16,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-26 07:01:16,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-26 07:01:16,550 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-26 07:01:16,749 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. completed. 2023-09-26 07:01:16,749 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. 2023-09-26 07:01:16,749 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:01:16,749 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:01:16,749 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:16,750 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-26 07:01:16,750 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42373,1695711667152' in zk 2023-09-26 07:01:16,752 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:16,752 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-26 07:01:16,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:16,752 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:16,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:16,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:16,752 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-26 07:01:16,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:16,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:16,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:16,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:16,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:16,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:16,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:16,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:16,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:16,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42373,1695711667152': 2023-09-26 07:01:16,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42373,1695711667152' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-26 07:01:16,759 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-26 07:01:16,759 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 07:01:16,759 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 07:01:16,759 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,759 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 07:01:16,763 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,763 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:16,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:16,763 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:16,763 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,763 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,763 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:16,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:16,763 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:16,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,764 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:16,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:16,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:16,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:16,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:16,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:16,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:16,764 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:16,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:16,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,765 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:16,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:16,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:16,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:16,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:16,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:16,768 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:16,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:16,768 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:16,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:16,769 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:16,784 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:16,784 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:16,784 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:16,785 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:16,785 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:16,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:16,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:16,785 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:16,785 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,784 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:16,786 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-26 07:01:16,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:16,785 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:16,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,786 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:16,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 07:01:16,786 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,785 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:16,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:16,785 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:16,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:16,786 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:16,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:16,787 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,787 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:16,787 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:16,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:16,787 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:16,787 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:16,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:16,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:16,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-26 07:01:16,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,850 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:01:16,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-26 07:01:16,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-26 07:01:16,855 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-26 07:01:16,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,869 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-26 07:01:16,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,870 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:16,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695711676225Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695711676809 (+584 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695711676809Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695711676809Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695711676825 (+16 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695711676856 (+31 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695711676869 (+13 ms) 2023-09-26 07:01:16,873 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-26 07:01:16,875 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 645 msec 2023-09-26 07:01:17,356 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:01:17,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-26 07:01:17,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 07:01:17,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42373] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 07:01:17,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39873] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 07:01:17,380 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-26 07:01:17,380 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. 2023-09-26 07:01:17,380 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 07:01:17,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-26 07:01:17,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695711677395 (current time:1695711677395). 2023-09-26 07:01:17,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 07:01:17,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x4e7a5d5c to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:01:17,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57d9fbe8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:01:17,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:17,410 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:01:17,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e7a5d5c to 127.0.0.1:50261 2023-09-26 07:01:17,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:01:17,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x4e3d5c63 to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:01:17,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52316845, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:01:17,421 DEBUG [hconnection-0x4a2fdf50-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:17,425 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54258, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:01:17,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:17,432 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39258, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:01:17,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e3d5c63 to 127.0.0.1:50261 2023-09-26 07:01:17,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:01:17,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-26 07:01:17,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 07:01:17,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-26 07:01:17,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-26 07:01:17,439 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-26 07:01:17,440 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695712277440 2023-09-26 07:01:17,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-26 07:01:17,440 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-26 07:01:17,441 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 07:01:17,442 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 07:01:17,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-26 07:01:17,443 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-26 07:01:17,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-09-26 07:01:17,446 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-26 07:01:17,447 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695712277447 2023-09-26 07:01:17,464 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-26 07:01:17,464 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-26 07:01:17,464 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:17,465 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-26 07:01:17,465 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-26 07:01:17,466 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,466 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,467 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:17,467 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:17,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:17,467 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:17,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:17,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:17,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:17,467 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:17,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:17,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:17,468 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:17,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,468 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:17,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,468 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,468 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,469 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:17,469 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 07:01:17,469 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-26 07:01:17,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-26 07:01:17,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-26 07:01:17,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,469 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-26 07:01:17,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,469 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-26 07:01:17,470 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-26 07:01:17,470 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-26 07:01:17,470 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-26 07:01:17,470 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:17,471 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-26 07:01:17,471 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-26 07:01:17,471 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-26 07:01:17,471 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-26 07:01:17,471 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-26 07:01:17,471 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-26 07:01:17,471 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42373,1695711667152' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-26 07:01:17,472 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:17,471 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:17,473 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-26 07:01:17,474 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-26 07:01:17,474 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-26 07:01:17,474 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39873,1695711667206' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-26 07:01:17,474 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-26 07:01:17,474 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32791,1695711667250' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-26 07:01:17,476 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:17,476 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:17,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:17,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:17,477 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:17,477 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,479 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:17,479 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,479 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,479 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:01:17,479 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:01:17,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:17,480 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,480 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:01:17,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-26 07:01:17,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:17,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:17,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:17,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:17,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42373,1695711667152' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-26 07:01:17,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@183414ee[Count = 1] remaining members to acquire global barrier 2023-09-26 07:01:17,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:17,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:17,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:17,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:17,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:17,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-26 07:01:17,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:17,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:17,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:17,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:17,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39873,1695711667206' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-26 07:01:17,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@183414ee[Count = 0] remaining members to acquire global barrier 2023-09-26 07:01:17,485 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-26 07:01:17,485 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,489 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,489 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,489 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,489 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:17,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,489 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-26 07:01:17,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,489 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-26 07:01:17,490 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-26 07:01:17,490 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:17,490 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 07:01:17,490 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-26 07:01:17,490 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:01:17,490 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:01:17,490 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. 2023-09-26 07:01:17,490 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,32791,1695711667250' in zk 2023-09-26 07:01:17,490 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. started... 2023-09-26 07:01:17,490 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:01:17,490 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:01:17,490 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0. 2023-09-26 07:01:17,490 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0. started... 2023-09-26 07:01:17,490 INFO [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ba04b02f9e59516b15829d22adb73fac 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-26 07:01:17,490 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 882bdb7634d941ac8443760e3dcafbf0 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-26 07:01:17,493 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-26 07:01:17,493 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:17,493 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-26 07:01:17,542 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:01:17,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-26 07:01:17,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-26 07:01:17,544 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 07:01:17,632 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230926994359879bfe4da3996749624e797a7a to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230926994359879bfe4da3996749624e797a7a 2023-09-26 07:01:17,632 INFO [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309263ce0aed7f3714768a2a7b7f8b4e65125 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309263ce0aed7f3714768a2a7b7f8b4e65125 2023-09-26 07:01:17,667 INFO [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/ba04b02f9e59516b15829d22adb73fac/.tmp/cf/d6a838986ce9430693f330db390e9efe 2023-09-26 07:01:17,668 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/882bdb7634d941ac8443760e3dcafbf0/.tmp/cf/11fa0d40823346d4b683f28dba7800d2 2023-09-26 07:01:17,684 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/882bdb7634d941ac8443760e3dcafbf0/.tmp/cf/11fa0d40823346d4b683f28dba7800d2 as hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/882bdb7634d941ac8443760e3dcafbf0/cf/11fa0d40823346d4b683f28dba7800d2 2023-09-26 07:01:17,684 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/ba04b02f9e59516b15829d22adb73fac/.tmp/cf/d6a838986ce9430693f330db390e9efe as hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/ba04b02f9e59516b15829d22adb73fac/cf/d6a838986ce9430693f330db390e9efe 2023-09-26 07:01:17,693 INFO [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/ba04b02f9e59516b15829d22adb73fac/cf/d6a838986ce9430693f330db390e9efe, entries=6, sequenceid=6, filesize=5.9 K 2023-09-26 07:01:17,694 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/882bdb7634d941ac8443760e3dcafbf0/cf/11fa0d40823346d4b683f28dba7800d2, entries=44, sequenceid=6, filesize=12.3 K 2023-09-26 07:01:17,698 INFO [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for ba04b02f9e59516b15829d22adb73fac in 208ms, sequenceid=6, compaction requested=false 2023-09-26 07:01:17,698 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 882bdb7634d941ac8443760e3dcafbf0 in 208ms, sequenceid=6, compaction requested=false 2023-09-26 07:01:17,698 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-26 07:01:17,698 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-26 07:01:17,701 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ba04b02f9e59516b15829d22adb73fac: 2023-09-26 07:01:17,702 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-26 07:01:17,702 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:01:17,702 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/ba04b02f9e59516b15829d22adb73fac/cf/d6a838986ce9430693f330db390e9efe] hfiles 2023-09-26 07:01:17,702 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/ba04b02f9e59516b15829d22adb73fac/cf/d6a838986ce9430693f330db390e9efe for snapshot=snaptb0-testExportWithTargetName 2023-09-26 07:01:17,704 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 882bdb7634d941ac8443760e3dcafbf0: 2023-09-26 07:01:17,704 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-26 07:01:17,704 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:01:17,704 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/882bdb7634d941ac8443760e3dcafbf0/cf/11fa0d40823346d4b683f28dba7800d2] hfiles 2023-09-26 07:01:17,704 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/882bdb7634d941ac8443760e3dcafbf0/cf/11fa0d40823346d4b683f28dba7800d2 for snapshot=snaptb0-testExportWithTargetName 2023-09-26 07:01:17,730 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0. completed. 2023-09-26 07:01:17,730 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0. 2023-09-26 07:01:17,730 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:01:17,730 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:01:17,730 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:17,730 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-26 07:01:17,730 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39873,1695711667206' in zk 2023-09-26 07:01:17,731 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. completed. 2023-09-26 07:01:17,731 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. 2023-09-26 07:01:17,731 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:01:17,731 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:01:17,731 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:17,731 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-26 07:01:17,731 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42373,1695711667152' in zk 2023-09-26 07:01:17,733 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-26 07:01:17,733 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:17,733 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:17,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:17,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:17,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:17,733 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-26 07:01:17,736 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:17,736 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-26 07:01:17,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:17,736 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:17,736 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-26 07:01:17,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:17,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-26 07:01:17,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:17,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:17,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:17,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:17,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-26 07:01:17,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:17,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:17,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:17,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39873,1695711667206': 2023-09-26 07:01:17,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39873,1695711667206' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-26 07:01:17,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:17,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:17,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:17,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:17,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:17,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-26 07:01:17,744 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:01:17,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:17,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:17,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:17,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-26 07:01:17,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-26 07:01:17,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:17,746 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-26 07:01:17,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-26 07:01:17,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:17,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:17,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:17,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42373,1695711667152': 2023-09-26 07:01:17,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42373,1695711667152' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-26 07:01:17,749 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-26 07:01:17,749 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 07:01:17,749 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 07:01:17,749 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-26 07:01:17,749 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 07:01:17,751 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,751 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,751 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,751 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,751 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:17,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,751 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:17,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:17,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:17,751 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:17,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,752 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:17,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:17,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:17,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:17,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:17,753 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:17,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:17,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:17,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:17,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,753 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:17,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-26 07:01:17,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:17,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-26 07:01:17,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:17,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:17,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:17,756 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:17,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:17,756 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:17,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-26 07:01:17,757 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:17,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:17,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:17,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:17,771 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:17,771 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:17,771 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:17,771 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:17,771 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:17,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:17,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:17,772 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:17,771 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:17,771 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:17,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:17,771 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:17,771 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:17,773 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:17,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:17,772 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-26 07:01:17,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:17,774 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-26 07:01:17,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:17,773 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,774 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-26 07:01:17,774 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:17,774 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 07:01:17,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:17,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:17,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:17,774 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,774 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:17,774 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:17,774 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,774 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:17,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:17,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230926994359879bfe4da3996749624e797a7a, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309263ce0aed7f3714768a2a7b7f8b4e65125] mob files 2023-09-26 07:01:17,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230926994359879bfe4da3996749624e797a7a 2023-09-26 07:01:17,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309263ce0aed7f3714768a2a7b7f8b4e65125 2023-09-26 07:01:17,795 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-26 07:01:17,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,836 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-26 07:01:17,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,837 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-26 07:01:17,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695711677440Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695711677795 (+355 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695711677795Loading Region manifests for snaptb0-testExportWithTargetName at 1695711677795Writing data manifest for snaptb0-testExportWithTargetName at 1695711677800 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695711677824 (+24 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695711677836 (+12 ms) 2023-09-26 07:01:17,840 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-26 07:01:17,843 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 399 msec 2023-09-26 07:01:18,046 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:01:18,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-26 07:01:18,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 07:01:18,050 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711678050 2023-09-26 07:01:18,051 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36301, tgtDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711678050, rawTgtDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711678050, srcFsUri=hdfs://localhost:36301, srcDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1 2023-09-26 07:01:18,091 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36301, inputRoot=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1 2023-09-26 07:01:18,091 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1702451116_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711678050, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711678050/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-26 07:01:18,091 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36301, inputRoot=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1, snapshotDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-26 07:01:18,115 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711678050/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-26 07:01:18,195 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:18,196 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:18,197 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:18,198 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:19,139 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/hadoop-3912638966496883270.jar 2023-09-26 07:01:19,140 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:19,140 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:19,208 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/hadoop-6532627614307664417.jar 2023-09-26 07:01:19,209 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:19,209 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:19,209 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:19,210 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:19,211 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:19,211 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:19,212 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-26 07:01:19,212 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-26 07:01:19,213 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-26 07:01:19,213 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-26 07:01:19,214 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-26 07:01:19,214 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-26 07:01:19,215 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-26 07:01:19,215 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-26 07:01:19,216 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-26 07:01:19,217 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-26 07:01:19,220 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:01:19,221 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:01:19,221 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 07:01:19,221 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:01:19,222 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:01:19,223 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 07:01:19,223 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 07:01:20,147 WARN [Listener at jenkins-hbase4.apache.org/41375] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-26 07:01:20,154 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-26 07:01:20,163 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-26 07:01:20,623 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 07:01:20,625 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 07:01:20,939 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-26 07:01:20,986 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0001_000001 (auth:SIMPLE) 2023-09-26 07:01:25,496 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0001_000001 (auth:SIMPLE) 2023-09-26 07:01:27,758 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0001_000001 (auth:SIMPLE) 2023-09-26 07:01:30,599 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0001_000001 (auth:SIMPLE) 2023-09-26 07:01:32,022 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-26 07:01:32,026 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-26 07:01:32,038 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-26 07:01:32,038 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-26 07:01:32,039 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-26 07:01:32,039 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2080754119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-26 07:01:32,040 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-26 07:01:32,040 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-26 07:01:32,040 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2080754119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711678050/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711678050/.hbase-snapshot/testExportWithTargetName 2023-09-26 07:01:32,040 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711678050/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-26 07:01:32,040 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711678050/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-26 07:01:32,051 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-26 07:01:32,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-26 07:01:32,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-26 07:01:32,070 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711692070"}]},"ts":"1695711692070"} 2023-09-26 07:01:32,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-26 07:01:32,072 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-26 07:01:32,074 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-26 07:01:32,076 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ba04b02f9e59516b15829d22adb73fac, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=882bdb7634d941ac8443760e3dcafbf0, UNASSIGN}] 2023-09-26 07:01:32,079 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ba04b02f9e59516b15829d22adb73fac, UNASSIGN 2023-09-26 07:01:32,079 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=882bdb7634d941ac8443760e3dcafbf0, UNASSIGN 2023-09-26 07:01:32,080 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=ba04b02f9e59516b15829d22adb73fac, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:32,080 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=882bdb7634d941ac8443760e3dcafbf0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:32,080 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695711692080"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711692080"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711692080"}]},"ts":"1695711692080"} 2023-09-26 07:01:32,080 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695711692080"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711692080"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711692080"}]},"ts":"1695711692080"} 2023-09-26 07:01:32,082 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure ba04b02f9e59516b15829d22adb73fac, server=jenkins-hbase4.apache.org,42373,1695711667152}] 2023-09-26 07:01:32,083 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 882bdb7634d941ac8443760e3dcafbf0, server=jenkins-hbase4.apache.org,39873,1695711667206}] 2023-09-26 07:01:32,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-26 07:01:32,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ba04b02f9e59516b15829d22adb73fac 2023-09-26 07:01:32,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 882bdb7634d941ac8443760e3dcafbf0 2023-09-26 07:01:32,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ba04b02f9e59516b15829d22adb73fac, disabling compactions & flushes 2023-09-26 07:01:32,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 882bdb7634d941ac8443760e3dcafbf0, disabling compactions & flushes 2023-09-26 07:01:32,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. 2023-09-26 07:01:32,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0. 2023-09-26 07:01:32,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. 2023-09-26 07:01:32,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0. 2023-09-26 07:01:32,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. after waiting 0 ms 2023-09-26 07:01:32,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0. after waiting 0 ms 2023-09-26 07:01:32,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. 2023-09-26 07:01:32,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0. 2023-09-26 07:01:32,260 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/882bdb7634d941ac8443760e3dcafbf0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 07:01:32,260 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportWithTargetName/ba04b02f9e59516b15829d22adb73fac/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 07:01:32,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:01:32,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:01:32,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0. 2023-09-26 07:01:32,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac. 2023-09-26 07:01:32,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 882bdb7634d941ac8443760e3dcafbf0: 2023-09-26 07:01:32,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ba04b02f9e59516b15829d22adb73fac: 2023-09-26 07:01:32,268 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 882bdb7634d941ac8443760e3dcafbf0 2023-09-26 07:01:32,268 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=882bdb7634d941ac8443760e3dcafbf0, regionState=CLOSED 2023-09-26 07:01:32,269 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695711692268"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711692268"}]},"ts":"1695711692268"} 2023-09-26 07:01:32,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ba04b02f9e59516b15829d22adb73fac 2023-09-26 07:01:32,270 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=ba04b02f9e59516b15829d22adb73fac, regionState=CLOSED 2023-09-26 07:01:32,270 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695711692269"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711692269"}]},"ts":"1695711692269"} 2023-09-26 07:01:32,274 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-26 07:01:32,274 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 882bdb7634d941ac8443760e3dcafbf0, server=jenkins-hbase4.apache.org,39873,1695711667206 in 188 msec 2023-09-26 07:01:32,275 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-26 07:01:32,275 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure ba04b02f9e59516b15829d22adb73fac, server=jenkins-hbase4.apache.org,42373,1695711667152 in 190 msec 2023-09-26 07:01:32,276 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=882bdb7634d941ac8443760e3dcafbf0, UNASSIGN in 198 msec 2023-09-26 07:01:32,278 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-09-26 07:01:32,278 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ba04b02f9e59516b15829d22adb73fac, UNASSIGN in 199 msec 2023-09-26 07:01:32,280 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711692279"}]},"ts":"1695711692279"} 2023-09-26 07:01:32,281 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-26 07:01:32,283 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-26 07:01:32,286 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 225 msec 2023-09-26 07:01:32,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-26 07:01:32,374 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-26 07:01:32,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-26 07:01:32,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-26 07:01:32,391 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-26 07:01:32,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-26 07:01:32,394 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-26 07:01:32,398 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39873] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-26 07:01:32,401 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportWithTargetName/ba04b02f9e59516b15829d22adb73fac 2023-09-26 07:01:32,401 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportWithTargetName/882bdb7634d941ac8443760e3dcafbf0 2023-09-26 07:01:32,401 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-26 07:01:32,401 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-26 07:01:32,401 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-26 07:01:32,402 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-26 07:01:32,403 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-26 07:01:32,403 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-26 07:01:32,403 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-26 07:01:32,404 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-26 07:01:32,404 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-26 07:01:32,404 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:01:32,404 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-26 07:01:32,404 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-26 07:01:32,404 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:01:32,404 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:01:32,404 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:01:32,404 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-26 07:01:32,407 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportWithTargetName/882bdb7634d941ac8443760e3dcafbf0/cf, FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportWithTargetName/882bdb7634d941ac8443760e3dcafbf0/recovered.edits] 2023-09-26 07:01:32,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-26 07:01:32,410 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportWithTargetName/ba04b02f9e59516b15829d22adb73fac/cf, FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportWithTargetName/ba04b02f9e59516b15829d22adb73fac/recovered.edits] 2023-09-26 07:01:32,416 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportWithTargetName/882bdb7634d941ac8443760e3dcafbf0/cf/11fa0d40823346d4b683f28dba7800d2 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportWithTargetName/882bdb7634d941ac8443760e3dcafbf0/cf/11fa0d40823346d4b683f28dba7800d2 2023-09-26 07:01:32,416 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportWithTargetName/ba04b02f9e59516b15829d22adb73fac/cf/d6a838986ce9430693f330db390e9efe to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportWithTargetName/ba04b02f9e59516b15829d22adb73fac/cf/d6a838986ce9430693f330db390e9efe 2023-09-26 07:01:32,421 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportWithTargetName/882bdb7634d941ac8443760e3dcafbf0/recovered.edits/9.seqid to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportWithTargetName/882bdb7634d941ac8443760e3dcafbf0/recovered.edits/9.seqid 2023-09-26 07:01:32,421 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportWithTargetName/ba04b02f9e59516b15829d22adb73fac/recovered.edits/9.seqid to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportWithTargetName/ba04b02f9e59516b15829d22adb73fac/recovered.edits/9.seqid 2023-09-26 07:01:32,422 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportWithTargetName/882bdb7634d941ac8443760e3dcafbf0 2023-09-26 07:01:32,422 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportWithTargetName/ba04b02f9e59516b15829d22adb73fac 2023-09-26 07:01:32,422 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-26 07:01:32,423 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-26 07:01:32,424 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-26 07:01:32,429 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230926994359879bfe4da3996749624e797a7a to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230926994359879bfe4da3996749624e797a7a 2023-09-26 07:01:32,430 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309263ce0aed7f3714768a2a7b7f8b4e65125 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309263ce0aed7f3714768a2a7b7f8b4e65125 2023-09-26 07:01:32,431 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-26 07:01:32,435 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-26 07:01:32,460 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-26 07:01:32,463 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-26 07:01:32,465 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-26 07:01:32,465 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-26 07:01:32,465 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695711692465"}]},"ts":"9223372036854775807"} 2023-09-26 07:01:32,465 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695711692465"}]},"ts":"9223372036854775807"} 2023-09-26 07:01:32,468 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-26 07:01:32,468 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ba04b02f9e59516b15829d22adb73fac, NAME => 'testtb-testExportWithTargetName,,1695711674944.ba04b02f9e59516b15829d22adb73fac.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 882bdb7634d941ac8443760e3dcafbf0, NAME => 'testtb-testExportWithTargetName,1,1695711674944.882bdb7634d941ac8443760e3dcafbf0.', STARTKEY => '1', ENDKEY => ''}] 2023-09-26 07:01:32,468 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-26 07:01:32,468 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695711692468"}]},"ts":"9223372036854775807"} 2023-09-26 07:01:32,470 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-26 07:01:32,473 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-26 07:01:32,477 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 91 msec 2023-09-26 07:01:32,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-26 07:01:32,514 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-26 07:01:32,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-26 07:01:32,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-26 07:01:32,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-26 07:01:32,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-26 07:01:32,583 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=753 (was 704) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x354067f6-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-988853158_1 at /127.0.0.1:58924 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/cluster_4e183e78-ccf4-5782-402b-e9b6bcc58056/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2080754119_17 at /127.0.0.1:58946 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (631867414) connection to jenkins-hbase4.apache.org/172.31.14.131:41375 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1285 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (631867414) connection to jenkins-hbase4.apache.org/172.31.14.131:42477 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (631867414) connection to jenkins-hbase4.apache.org/172.31.14.131:44151 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x354067f6-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2080754119_17 at /127.0.0.1:34388 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x354067f6-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/cluster_4e183e78-ccf4-5782-402b-e9b6bcc58056/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/cluster_4e183e78-ccf4-5782-402b-e9b6bcc58056/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/cluster_4e183e78-ccf4-5782-402b-e9b6bcc58056/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x354067f6-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2080754119_17 at /127.0.0.1:54610 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/cluster_4e183e78-ccf4-5782-402b-e9b6bcc58056/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-988853158_1 at /127.0.0.1:54596 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/cluster_4e183e78-ccf4-5782-402b-e9b6bcc58056/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=256 (was 200) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=4681 (was 5449) 2023-09-26 07:01:32,584 WARN [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-09-26 07:01:32,606 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=256, ProcessCount=168, AvailableMemoryMB=4681 2023-09-26 07:01:32,606 WARN [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-09-26 07:01:32,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-26 07:01:32,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-26 07:01:32,615 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-26 07:01:32,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-26 07:01:32,617 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-26 07:01:32,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-26 07:01:32,621 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemState/55dacdbb0f83b51b8b2487a61c580660 2023-09-26 07:01:32,621 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemState/ac48292833522927716554c6880d3acb 2023-09-26 07:01:32,622 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemState/55dacdbb0f83b51b8b2487a61c580660 empty. 2023-09-26 07:01:32,622 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemState/ac48292833522927716554c6880d3acb empty. 2023-09-26 07:01:32,622 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemState/55dacdbb0f83b51b8b2487a61c580660 2023-09-26 07:01:32,622 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemState/ac48292833522927716554c6880d3acb 2023-09-26 07:01:32,622 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-26 07:01:32,643 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-26 07:01:32,644 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 55dacdbb0f83b51b8b2487a61c580660, NAME => 'testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp 2023-09-26 07:01:32,644 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => ac48292833522927716554c6880d3acb, NAME => 'testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp 2023-09-26 07:01:32,667 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:01:32,667 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing ac48292833522927716554c6880d3acb, disabling compactions & flushes 2023-09-26 07:01:32,667 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb. 2023-09-26 07:01:32,667 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb. 2023-09-26 07:01:32,667 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb. after waiting 0 ms 2023-09-26 07:01:32,667 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb. 2023-09-26 07:01:32,668 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb. 2023-09-26 07:01:32,668 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for ac48292833522927716554c6880d3acb: 2023-09-26 07:01:32,679 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:01:32,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 55dacdbb0f83b51b8b2487a61c580660, disabling compactions & flushes 2023-09-26 07:01:32,680 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. 2023-09-26 07:01:32,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. 2023-09-26 07:01:32,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. after waiting 0 ms 2023-09-26 07:01:32,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. 2023-09-26 07:01:32,680 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. 2023-09-26 07:01:32,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 55dacdbb0f83b51b8b2487a61c580660: 2023-09-26 07:01:32,683 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-26 07:01:32,684 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695711692684"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711692684"}]},"ts":"1695711692684"} 2023-09-26 07:01:32,685 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695711692684"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711692684"}]},"ts":"1695711692684"} 2023-09-26 07:01:32,688 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-26 07:01:32,689 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-26 07:01:32,689 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711692689"}]},"ts":"1695711692689"} 2023-09-26 07:01:32,692 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-26 07:01:32,695 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-26 07:01:32,697 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-26 07:01:32,697 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-26 07:01:32,697 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-26 07:01:32,697 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-26 07:01:32,698 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=55dacdbb0f83b51b8b2487a61c580660, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ac48292833522927716554c6880d3acb, ASSIGN}] 2023-09-26 07:01:32,702 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ac48292833522927716554c6880d3acb, ASSIGN 2023-09-26 07:01:32,702 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=55dacdbb0f83b51b8b2487a61c580660, ASSIGN 2023-09-26 07:01:32,703 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ac48292833522927716554c6880d3acb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32791,1695711667250; forceNewPlan=false, retain=false 2023-09-26 07:01:32,703 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=55dacdbb0f83b51b8b2487a61c580660, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39873,1695711667206; forceNewPlan=false, retain=false 2023-09-26 07:01:32,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-26 07:01:32,853 INFO [jenkins-hbase4:38147] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-26 07:01:32,856 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ac48292833522927716554c6880d3acb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:32,856 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=55dacdbb0f83b51b8b2487a61c580660, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:32,856 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695711692856"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711692856"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711692856"}]},"ts":"1695711692856"} 2023-09-26 07:01:32,857 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695711692856"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711692856"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711692856"}]},"ts":"1695711692856"} 2023-09-26 07:01:32,859 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure ac48292833522927716554c6880d3acb, server=jenkins-hbase4.apache.org,32791,1695711667250}] 2023-09-26 07:01:32,860 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 55dacdbb0f83b51b8b2487a61c580660, server=jenkins-hbase4.apache.org,39873,1695711667206}] 2023-09-26 07:01:32,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-26 07:01:33,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. 2023-09-26 07:01:33,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 55dacdbb0f83b51b8b2487a61c580660, NAME => 'testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660.', STARTKEY => '', ENDKEY => '1'} 2023-09-26 07:01:33,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb. 2023-09-26 07:01:33,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ac48292833522927716554c6880d3acb, NAME => 'testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb.', STARTKEY => '1', ENDKEY => ''} 2023-09-26 07:01:33,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. service=AccessControlService 2023-09-26 07:01:33,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 07:01:33,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 55dacdbb0f83b51b8b2487a61c580660 2023-09-26 07:01:33,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb. service=AccessControlService 2023-09-26 07:01:33,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:01:33,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 55dacdbb0f83b51b8b2487a61c580660 2023-09-26 07:01:33,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 07:01:33,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 55dacdbb0f83b51b8b2487a61c580660 2023-09-26 07:01:33,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState ac48292833522927716554c6880d3acb 2023-09-26 07:01:33,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:01:33,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ac48292833522927716554c6880d3acb 2023-09-26 07:01:33,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ac48292833522927716554c6880d3acb 2023-09-26 07:01:33,024 INFO [StoreOpener-ac48292833522927716554c6880d3acb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ac48292833522927716554c6880d3acb 2023-09-26 07:01:33,025 INFO [StoreOpener-55dacdbb0f83b51b8b2487a61c580660-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 55dacdbb0f83b51b8b2487a61c580660 2023-09-26 07:01:33,026 DEBUG [StoreOpener-ac48292833522927716554c6880d3acb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/ac48292833522927716554c6880d3acb/cf 2023-09-26 07:01:33,026 DEBUG [StoreOpener-ac48292833522927716554c6880d3acb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/ac48292833522927716554c6880d3acb/cf 2023-09-26 07:01:33,026 DEBUG [StoreOpener-55dacdbb0f83b51b8b2487a61c580660-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/55dacdbb0f83b51b8b2487a61c580660/cf 2023-09-26 07:01:33,027 DEBUG [StoreOpener-55dacdbb0f83b51b8b2487a61c580660-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/55dacdbb0f83b51b8b2487a61c580660/cf 2023-09-26 07:01:33,027 INFO [StoreOpener-ac48292833522927716554c6880d3acb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac48292833522927716554c6880d3acb columnFamilyName cf 2023-09-26 07:01:33,027 INFO [StoreOpener-55dacdbb0f83b51b8b2487a61c580660-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55dacdbb0f83b51b8b2487a61c580660 columnFamilyName cf 2023-09-26 07:01:33,029 INFO [StoreOpener-55dacdbb0f83b51b8b2487a61c580660-1] regionserver.HStore(310): Store=55dacdbb0f83b51b8b2487a61c580660/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:01:33,029 INFO [StoreOpener-ac48292833522927716554c6880d3acb-1] regionserver.HStore(310): Store=ac48292833522927716554c6880d3acb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:01:33,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/55dacdbb0f83b51b8b2487a61c580660 2023-09-26 07:01:33,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/55dacdbb0f83b51b8b2487a61c580660 2023-09-26 07:01:33,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/ac48292833522927716554c6880d3acb 2023-09-26 07:01:33,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/ac48292833522927716554c6880d3acb 2023-09-26 07:01:33,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 55dacdbb0f83b51b8b2487a61c580660 2023-09-26 07:01:33,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ac48292833522927716554c6880d3acb 2023-09-26 07:01:33,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/55dacdbb0f83b51b8b2487a61c580660/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 07:01:33,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/ac48292833522927716554c6880d3acb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 07:01:33,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 55dacdbb0f83b51b8b2487a61c580660; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71333217, jitterRate=0.06294776499271393}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 07:01:33,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 55dacdbb0f83b51b8b2487a61c580660: 2023-09-26 07:01:33,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ac48292833522927716554c6880d3acb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59574032, jitterRate=-0.11227774620056152}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 07:01:33,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ac48292833522927716554c6880d3acb: 2023-09-26 07:01:33,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660., pid=31, masterSystemTime=1695711693014 2023-09-26 07:01:33,040 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb., pid=30, masterSystemTime=1695711693011 2023-09-26 07:01:33,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. 2023-09-26 07:01:33,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. 2023-09-26 07:01:33,042 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=55dacdbb0f83b51b8b2487a61c580660, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb. 2023-09-26 07:01:33,042 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695711693042"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695711693042"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695711693042"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695711693042"}]},"ts":"1695711693042"} 2023-09-26 07:01:33,042 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb. 2023-09-26 07:01:33,043 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ac48292833522927716554c6880d3acb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,044 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695711693043"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695711693043"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695711693043"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695711693043"}]},"ts":"1695711693043"} 2023-09-26 07:01:33,048 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-09-26 07:01:33,048 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 55dacdbb0f83b51b8b2487a61c580660, server=jenkins-hbase4.apache.org,39873,1695711667206 in 186 msec 2023-09-26 07:01:33,049 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-09-26 07:01:33,051 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure ac48292833522927716554c6880d3acb, server=jenkins-hbase4.apache.org,32791,1695711667250 in 188 msec 2023-09-26 07:01:33,052 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=55dacdbb0f83b51b8b2487a61c580660, ASSIGN in 351 msec 2023-09-26 07:01:33,053 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-26 07:01:33,053 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ac48292833522927716554c6880d3acb, ASSIGN in 352 msec 2023-09-26 07:01:33,054 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-26 07:01:33,055 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711693054"}]},"ts":"1695711693054"} 2023-09-26 07:01:33,056 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-26 07:01:33,059 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-26 07:01:33,059 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-26 07:01:33,061 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39873] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-26 07:01:33,061 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-26 07:01:33,063 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:01:33,063 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:01:33,063 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:01:33,063 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:01:33,065 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-26 07:01:33,065 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-26 07:01:33,065 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-26 07:01:33,065 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-26 07:01:33,067 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 454 msec 2023-09-26 07:01:33,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-26 07:01:33,222 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-26 07:01:33,224 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-26 07:01:33,225 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. 2023-09-26 07:01:33,227 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 07:01:33,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 07:01:33,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695711693243 (current time:1695711693243). 2023-09-26 07:01:33,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 07:01:33,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x0eeaafb1 to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:01:33,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3db98c25, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:01:33,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:33,258 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52366, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:01:33,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0eeaafb1 to 127.0.0.1:50261 2023-09-26 07:01:33,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:01:33,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x60b19284 to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:01:33,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b7d3e04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:01:33,268 DEBUG [hconnection-0x4ad455ea-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:33,269 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:01:33,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:33,275 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:01:33,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60b19284 to 127.0.0.1:50261 2023-09-26 07:01:33,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:01:33,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-26 07:01:33,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 07:01:33,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 07:01:33,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-26 07:01:33,282 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-26 07:01:33,283 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695712293283 2023-09-26 07:01:33,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 07:01:33,283 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-26 07:01:33,284 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 07:01:33,285 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 07:01:33,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-26 07:01:33,286 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-26 07:01:33,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-26 07:01:33,289 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-26 07:01:33,290 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695712293290 2023-09-26 07:01:33,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,311 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-26 07:01:33,311 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:33,313 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-26 07:01:33,313 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-26 07:01:33,313 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,313 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,316 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,316 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:33,316 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:33,316 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:33,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:33,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:33,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:33,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:33,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:33,316 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:33,316 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,317 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,317 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 07:01:33,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-26 07:01:33,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,318 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,318 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-26 07:01:33,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-26 07:01:33,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,318 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,318 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-26 07:01:33,318 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-26 07:01:33,318 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:33,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-26 07:01:33,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,319 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-26 07:01:33,321 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,322 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-26 07:01:33,322 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-26 07:01:33,322 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:33,322 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,324 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-26 07:01:33,324 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-26 07:01:33,324 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:33,322 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-26 07:01:33,325 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-26 07:01:33,325 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-26 07:01:33,325 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42373,1695711667152' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-26 07:01:33,325 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39873,1695711667206' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-26 07:01:33,324 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-26 07:01:33,325 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32791,1695711667250' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-26 07:01:33,336 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,336 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,336 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:33,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:33,336 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,337 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,337 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,337 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,337 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:01:33,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:33,337 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:01:33,337 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,337 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:01:33,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:33,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:33,339 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39873,1695711667206' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-26 07:01:33,339 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65289481[Count = 1] remaining members to acquire global barrier 2023-09-26 07:01:33,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:33,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:33,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:33,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:33,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:33,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32791,1695711667250' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-26 07:01:33,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65289481[Count = 0] remaining members to acquire global barrier 2023-09-26 07:01:33,342 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-26 07:01:33,342 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,343 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,343 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,343 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,343 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-26 07:01:33,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,343 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,344 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:01:33,344 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-26 07:01:33,344 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-26 07:01:33,343 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-26 07:01:33,344 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42373,1695711667152' in zk 2023-09-26 07:01:33,344 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. 2023-09-26 07:01:33,344 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:01:33,344 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. started... 2023-09-26 07:01:33,344 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:01:33,344 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:01:33,344 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,344 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 07:01:33,344 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 55dacdbb0f83b51b8b2487a61c580660: 2023-09-26 07:01:33,344 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb. 2023-09-26 07:01:33,344 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb. started... 2023-09-26 07:01:33,344 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,345 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:01:33,346 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ac48292833522927716554c6880d3acb: 2023-09-26 07:01:33,347 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-26 07:01:33,347 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 07:01:33,347 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,347 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:33,347 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:01:33,347 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-26 07:01:33,348 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 07:01:33,376 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb. completed. 2023-09-26 07:01:33,376 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb. 2023-09-26 07:01:33,377 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:01:33,377 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:01:33,377 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,377 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-26 07:01:33,377 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32791,1695711667250' in zk 2023-09-26 07:01:33,377 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. completed. 2023-09-26 07:01:33,377 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. 2023-09-26 07:01:33,378 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:01:33,378 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:01:33,378 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,378 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-26 07:01:33,378 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39873,1695711667206' in zk 2023-09-26 07:01:33,380 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,380 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-26 07:01:33,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,380 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:33,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:33,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:33,380 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-26 07:01:33,383 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,383 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-26 07:01:33,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:33,383 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:33,383 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-26 07:01:33,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:33,385 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:01:33,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-26 07:01:33,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-26 07:01:33,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,386 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 07:01:33,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:33,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,32791,1695711667250': 2023-09-26 07:01:33,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32791,1695711667250' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-26 07:01:33,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:33,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:33,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:33,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:33,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:33,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39873,1695711667206': 2023-09-26 07:01:33,393 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39873,1695711667206' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-26 07:01:33,393 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-26 07:01:33,393 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 07:01:33,393 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 07:01:33,393 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,393 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 07:01:33,395 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,395 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,395 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:33,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,395 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:33,395 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,395 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,395 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:33,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:33,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:33,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:33,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:33,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:33,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:33,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:33,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:33,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,397 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:33,402 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,402 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:33,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,404 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:33,405 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,406 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,409 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,409 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,409 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:33,409 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:33,409 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,409 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:33,409 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:33,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:33,409 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,409 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:33,409 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:33,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:33,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:33,410 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:33,410 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-26 07:01:33,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:33,409 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:33,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 07:01:33,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:33,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:33,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:33,409 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,412 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,412 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,412 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,412 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,412 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,412 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:33,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:33,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-26 07:01:33,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:33,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:33,428 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,458 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-26 07:01:33,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,459 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:33,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695711693283Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695711693428 (+145 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695711693428Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695711693428Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695711693433 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695711693450 (+17 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695711693458 (+8 ms) 2023-09-26 07:01:33,462 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-26 07:01:33,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 178 msec 2023-09-26 07:01:33,588 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:01:33,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-26 07:01:33,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 07:01:33,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39873] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 07:01:33,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32791] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 07:01:33,602 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-26 07:01:33,602 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. 2023-09-26 07:01:33,603 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 07:01:33,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 07:01:33,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695711693617 (current time:1695711693617). 2023-09-26 07:01:33,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 07:01:33,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x730d8a6d to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:01:33,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1115a086, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:01:33,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:33,631 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:01:33,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x730d8a6d to 127.0.0.1:50261 2023-09-26 07:01:33,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:01:33,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x3f35ac73 to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:01:33,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c598212, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:01:33,642 DEBUG [hconnection-0xcf1c163-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:33,646 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:01:33,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:33,654 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36866, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:01:33,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f35ac73 to 127.0.0.1:50261 2023-09-26 07:01:33,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:01:33,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-26 07:01:33,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 07:01:33,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 07:01:33,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-26 07:01:33,662 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-26 07:01:33,663 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695712293663 2023-09-26 07:01:33,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 07:01:33,663 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-26 07:01:33,665 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 07:01:33,665 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 07:01:33,669 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-26 07:01:33,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-26 07:01:33,671 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-09-26 07:01:33,672 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-26 07:01:33,673 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695712293673 2023-09-26 07:01:33,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-26 07:01:33,688 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-26 07:01:33,689 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:33,690 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-26 07:01:33,690 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-26 07:01:33,691 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,691 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,694 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:33,694 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:33,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:33,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:33,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:33,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:33,694 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,694 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:33,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:33,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:33,695 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,695 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,696 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,696 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 07:01:33,696 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-26 07:01:33,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-26 07:01:33,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-26 07:01:33,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,696 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-26 07:01:33,696 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-26 07:01:33,696 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-26 07:01:33,696 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-26 07:01:33,697 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-26 07:01:33,697 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:33,698 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-26 07:01:33,698 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-26 07:01:33,698 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42373,1695711667152' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-26 07:01:33,698 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-26 07:01:33,698 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-26 07:01:33,698 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-26 07:01:33,698 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-26 07:01:33,699 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:33,698 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:33,700 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-26 07:01:33,701 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-26 07:01:33,701 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39873,1695711667206' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-26 07:01:33,701 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-26 07:01:33,701 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-26 07:01:33,701 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32791,1695711667250' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-26 07:01:33,703 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,703 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,703 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:01:33,704 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,704 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:33,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:33,704 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,704 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,704 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,704 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:01:33,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:33,704 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,705 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:01:33,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:33,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-26 07:01:33,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:33,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32791,1695711667250' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-26 07:01:33,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12f0cbad[Count = 1] remaining members to acquire global barrier 2023-09-26 07:01:33,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:33,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:33,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:33,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:33,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-26 07:01:33,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:33,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39873,1695711667206' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-26 07:01:33,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12f0cbad[Count = 0] remaining members to acquire global barrier 2023-09-26 07:01:33,709 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-26 07:01:33,709 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,710 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,710 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,710 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,711 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-26 07:01:33,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,711 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,711 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-26 07:01:33,711 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-26 07:01:33,711 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:01:33,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,711 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb. 2023-09-26 07:01:33,711 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,711 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb. started... 2023-09-26 07:01:33,711 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:01:33,711 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42373,1695711667152' in zk 2023-09-26 07:01:33,711 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 07:01:33,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,711 INFO [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ac48292833522927716554c6880d3acb 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-26 07:01:33,712 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-26 07:01:33,712 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:01:33,712 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:01:33,712 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. 2023-09-26 07:01:33,712 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. started... 2023-09-26 07:01:33,712 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 55dacdbb0f83b51b8b2487a61c580660 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-26 07:01:33,715 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-26 07:01:33,715 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:33,715 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-26 07:01:33,752 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309267c9d1082b4fa4af9b0706c2dd0b2e6ec to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309267c9d1082b4fa4af9b0706c2dd0b2e6ec 2023-09-26 07:01:33,756 INFO [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230926bc1812ac4205451fbdc90a71af643a54 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230926bc1812ac4205451fbdc90a71af643a54 2023-09-26 07:01:33,765 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:01:33,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-26 07:01:33,773 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/55dacdbb0f83b51b8b2487a61c580660/.tmp/cf/a787ba12bf424208a0bbcd6362acdfa8 2023-09-26 07:01:33,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-26 07:01:33,778 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 07:01:33,782 INFO [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/ac48292833522927716554c6880d3acb/.tmp/cf/b0797092be904a638427edeb7a249c5a 2023-09-26 07:01:33,786 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/55dacdbb0f83b51b8b2487a61c580660/.tmp/cf/a787ba12bf424208a0bbcd6362acdfa8 as hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/55dacdbb0f83b51b8b2487a61c580660/cf/a787ba12bf424208a0bbcd6362acdfa8 2023-09-26 07:01:33,791 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/ac48292833522927716554c6880d3acb/.tmp/cf/b0797092be904a638427edeb7a249c5a as hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/ac48292833522927716554c6880d3acb/cf/b0797092be904a638427edeb7a249c5a 2023-09-26 07:01:33,793 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/55dacdbb0f83b51b8b2487a61c580660/cf/a787ba12bf424208a0bbcd6362acdfa8, entries=2, sequenceid=6, filesize=5.2 K 2023-09-26 07:01:33,794 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 55dacdbb0f83b51b8b2487a61c580660 in 82ms, sequenceid=6, compaction requested=false 2023-09-26 07:01:33,796 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 55dacdbb0f83b51b8b2487a61c580660: 2023-09-26 07:01:33,796 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-26 07:01:33,796 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:01:33,796 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/55dacdbb0f83b51b8b2487a61c580660/cf/a787ba12bf424208a0bbcd6362acdfa8] hfiles 2023-09-26 07:01:33,796 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/55dacdbb0f83b51b8b2487a61c580660/cf/a787ba12bf424208a0bbcd6362acdfa8 for snapshot=snaptb0-testExportFileSystemState 2023-09-26 07:01:33,800 INFO [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/ac48292833522927716554c6880d3acb/cf/b0797092be904a638427edeb7a249c5a, entries=48, sequenceid=6, filesize=13.0 K 2023-09-26 07:01:33,801 INFO [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for ac48292833522927716554c6880d3acb in 90ms, sequenceid=6, compaction requested=false 2023-09-26 07:01:33,801 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ac48292833522927716554c6880d3acb: 2023-09-26 07:01:33,801 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-26 07:01:33,802 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:01:33,802 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/ac48292833522927716554c6880d3acb/cf/b0797092be904a638427edeb7a249c5a] hfiles 2023-09-26 07:01:33,802 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/ac48292833522927716554c6880d3acb/cf/b0797092be904a638427edeb7a249c5a for snapshot=snaptb0-testExportFileSystemState 2023-09-26 07:01:33,820 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. completed. 2023-09-26 07:01:33,820 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. 2023-09-26 07:01:33,820 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:01:33,820 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:01:33,820 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,820 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-26 07:01:33,820 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39873,1695711667206' in zk 2023-09-26 07:01:33,825 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,825 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-26 07:01:33,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:33,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:33,826 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:33,826 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-26 07:01:33,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:33,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:33,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-26 07:01:33,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:33,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-26 07:01:33,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39873,1695711667206': 2023-09-26 07:01:33,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39873,1695711667206' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-26 07:01:33,837 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb. completed. 2023-09-26 07:01:33,837 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb. 2023-09-26 07:01:33,837 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:01:33,837 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:01:33,837 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,837 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-26 07:01:33,837 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32791,1695711667250' in zk 2023-09-26 07:01:33,839 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-26 07:01:33,839 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,839 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:33,839 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-26 07:01:33,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:33,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:33,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:33,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:33,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-26 07:01:33,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:33,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-26 07:01:33,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,32791,1695711667250': 2023-09-26 07:01:33,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32791,1695711667250' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-26 07:01:33,845 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-26 07:01:33,845 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 07:01:33,845 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 07:01:33,845 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-26 07:01:33,845 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 07:01:33,848 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,848 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,848 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,848 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,849 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:33,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,848 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:33,848 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:33,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:33,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:33,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:33,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:33,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:33,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:33,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,850 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:33,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:33,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:33,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-26 07:01:33,851 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:33,852 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-26 07:01:33,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,854 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:33,854 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-26 07:01:33,855 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,858 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,858 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,858 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:33,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:33,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:33,858 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:33,859 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:33,859 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:33,859 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:33,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:33,859 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:33,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:33,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:33,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:33,859 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:33,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:33,859 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:33,859 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-26 07:01:33,861 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-26 07:01:33,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:33,859 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:33,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-26 07:01:33,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:33,862 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 07:01:33,861 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:33,862 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:33,862 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,862 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:33,862 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:33,862 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,862 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,863 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230926bc1812ac4205451fbdc90a71af643a54, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309267c9d1082b4fa4af9b0706c2dd0b2e6ec] mob files 2023-09-26 07:01:33,863 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230926bc1812ac4205451fbdc90a71af643a54 2023-09-26 07:01:33,863 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309267c9d1082b4fa4af9b0706c2dd0b2e6ec 2023-09-26 07:01:33,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-26 07:01:33,878 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,911 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,912 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-26 07:01:33,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,913 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-26 07:01:33,913 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695711693663Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695711693877 (+214 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695711693877Loading Region manifests for snaptb0-testExportFileSystemState at 1695711693877Writing data manifest for snaptb0-testExportFileSystemState at 1695711693882 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695711693901 (+19 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695711693912 (+11 ms) 2023-09-26 07:01:33,915 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-26 07:01:33,918 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 251 msec 2023-09-26 07:01:33,978 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:01:33,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-26 07:01:33,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 07:01:33,980 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711693980 2023-09-26 07:01:33,980 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36301, tgtDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711693980, rawTgtDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711693980, srcFsUri=hdfs://localhost:36301, srcDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1 2023-09-26 07:01:34,004 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36301, inputRoot=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1 2023-09-26 07:01:34,004 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1006356462_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711693980, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711693980/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-26 07:01:34,004 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36301, inputRoot=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1, snapshotDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-26 07:01:34,022 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711693980/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-26 07:01:34,061 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:34,062 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:34,062 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:34,062 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:34,958 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/hadoop-2675179584439272769.jar 2023-09-26 07:01:34,958 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:34,958 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:35,025 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/hadoop-7075837015520282149.jar 2023-09-26 07:01:35,026 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:35,026 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:35,027 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:35,027 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:35,028 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:35,028 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:35,028 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-26 07:01:35,029 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-26 07:01:35,029 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-26 07:01:35,030 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-26 07:01:35,030 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-26 07:01:35,031 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-26 07:01:35,031 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-26 07:01:35,032 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-26 07:01:35,032 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-26 07:01:35,033 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-26 07:01:35,033 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:01:35,034 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:01:35,034 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 07:01:35,035 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:01:35,035 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:01:35,035 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 07:01:35,036 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 07:01:35,508 WARN [Listener at jenkins-hbase4.apache.org/41375] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-26 07:01:35,510 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-26 07:01:35,513 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-26 07:01:36,814 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 07:01:36,814 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 07:01:36,819 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0001_000001 (auth:SIMPLE) 2023-09-26 07:01:37,513 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0002_000001 (auth:SIMPLE) 2023-09-26 07:01:37,855 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-26 07:01:41,643 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0002_000001 (auth:SIMPLE) 2023-09-26 07:01:43,876 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0002_000001 (auth:SIMPLE) 2023-09-26 07:01:47,029 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0002_000001 (auth:SIMPLE) 2023-09-26 07:01:48,711 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-26 07:01:48,712 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-26 07:01:48,721 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-26 07:01:48,721 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-26 07:01:48,721 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-26 07:01:48,722 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2080754119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-26 07:01:48,722 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-26 07:01:48,722 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-26 07:01:48,722 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2080754119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711693980/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711693980/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-26 07:01:48,723 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711693980/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-26 07:01:48,723 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711693980/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-26 07:01:48,731 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-26 07:01:48,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-26 07:01:48,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-26 07:01:48,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-26 07:01:48,737 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711708737"}]},"ts":"1695711708737"} 2023-09-26 07:01:48,738 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-26 07:01:48,740 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-26 07:01:48,741 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=55dacdbb0f83b51b8b2487a61c580660, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ac48292833522927716554c6880d3acb, UNASSIGN}] 2023-09-26 07:01:48,743 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=55dacdbb0f83b51b8b2487a61c580660, UNASSIGN 2023-09-26 07:01:48,743 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ac48292833522927716554c6880d3acb, UNASSIGN 2023-09-26 07:01:48,744 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=55dacdbb0f83b51b8b2487a61c580660, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:48,744 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ac48292833522927716554c6880d3acb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:48,744 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695711708744"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711708744"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711708744"}]},"ts":"1695711708744"} 2023-09-26 07:01:48,744 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695711708744"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711708744"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711708744"}]},"ts":"1695711708744"} 2023-09-26 07:01:48,746 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 55dacdbb0f83b51b8b2487a61c580660, server=jenkins-hbase4.apache.org,39873,1695711667206}] 2023-09-26 07:01:48,746 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure ac48292833522927716554c6880d3acb, server=jenkins-hbase4.apache.org,32791,1695711667250}] 2023-09-26 07:01:48,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-26 07:01:48,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 55dacdbb0f83b51b8b2487a61c580660 2023-09-26 07:01:48,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 55dacdbb0f83b51b8b2487a61c580660, disabling compactions & flushes 2023-09-26 07:01:48,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. 2023-09-26 07:01:48,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. 2023-09-26 07:01:48,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. after waiting 0 ms 2023-09-26 07:01:48,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. 2023-09-26 07:01:48,902 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ac48292833522927716554c6880d3acb 2023-09-26 07:01:48,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ac48292833522927716554c6880d3acb, disabling compactions & flushes 2023-09-26 07:01:48,902 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb. 2023-09-26 07:01:48,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb. 2023-09-26 07:01:48,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb. after waiting 0 ms 2023-09-26 07:01:48,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb. 2023-09-26 07:01:48,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/55dacdbb0f83b51b8b2487a61c580660/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 07:01:48,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemState/ac48292833522927716554c6880d3acb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 07:01:48,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:01:48,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660. 2023-09-26 07:01:48,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 55dacdbb0f83b51b8b2487a61c580660: 2023-09-26 07:01:48,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:01:48,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb. 2023-09-26 07:01:48,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ac48292833522927716554c6880d3acb: 2023-09-26 07:01:48,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 55dacdbb0f83b51b8b2487a61c580660 2023-09-26 07:01:48,912 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=55dacdbb0f83b51b8b2487a61c580660, regionState=CLOSED 2023-09-26 07:01:48,913 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695711708912"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711708912"}]},"ts":"1695711708912"} 2023-09-26 07:01:48,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ac48292833522927716554c6880d3acb 2023-09-26 07:01:48,913 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ac48292833522927716554c6880d3acb, regionState=CLOSED 2023-09-26 07:01:48,913 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695711708913"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711708913"}]},"ts":"1695711708913"} 2023-09-26 07:01:48,917 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-26 07:01:48,917 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 55dacdbb0f83b51b8b2487a61c580660, server=jenkins-hbase4.apache.org,39873,1695711667206 in 168 msec 2023-09-26 07:01:48,917 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-26 07:01:48,918 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure ac48292833522927716554c6880d3acb, server=jenkins-hbase4.apache.org,32791,1695711667250 in 169 msec 2023-09-26 07:01:48,918 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=55dacdbb0f83b51b8b2487a61c580660, UNASSIGN in 176 msec 2023-09-26 07:01:48,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-26 07:01:48,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ac48292833522927716554c6880d3acb, UNASSIGN in 177 msec 2023-09-26 07:01:48,920 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711708920"}]},"ts":"1695711708920"} 2023-09-26 07:01:48,921 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-26 07:01:48,923 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-26 07:01:48,925 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 192 msec 2023-09-26 07:01:49,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-26 07:01:49,040 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-26 07:01:49,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-26 07:01:49,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-26 07:01:49,044 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-26 07:01:49,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-26 07:01:49,045 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-26 07:01:49,046 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39873] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-26 07:01:49,050 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-26 07:01:49,050 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-26 07:01:49,050 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-26 07:01:49,050 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-26 07:01:49,051 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-26 07:01:49,051 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-26 07:01:49,051 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-26 07:01:49,051 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-26 07:01:49,052 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-26 07:01:49,052 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-26 07:01:49,052 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-26 07:01:49,052 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:01:49,052 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:01:49,052 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-26 07:01:49,052 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:01:49,053 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:01:49,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-26 07:01:49,061 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemState/55dacdbb0f83b51b8b2487a61c580660 2023-09-26 07:01:49,061 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemState/ac48292833522927716554c6880d3acb 2023-09-26 07:01:49,063 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemState/ac48292833522927716554c6880d3acb/cf, FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemState/ac48292833522927716554c6880d3acb/recovered.edits] 2023-09-26 07:01:49,063 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemState/55dacdbb0f83b51b8b2487a61c580660/cf, FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemState/55dacdbb0f83b51b8b2487a61c580660/recovered.edits] 2023-09-26 07:01:49,069 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemState/ac48292833522927716554c6880d3acb/cf/b0797092be904a638427edeb7a249c5a to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemState/ac48292833522927716554c6880d3acb/cf/b0797092be904a638427edeb7a249c5a 2023-09-26 07:01:49,069 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemState/55dacdbb0f83b51b8b2487a61c580660/cf/a787ba12bf424208a0bbcd6362acdfa8 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemState/55dacdbb0f83b51b8b2487a61c580660/cf/a787ba12bf424208a0bbcd6362acdfa8 2023-09-26 07:01:49,073 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemState/ac48292833522927716554c6880d3acb/recovered.edits/9.seqid to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemState/ac48292833522927716554c6880d3acb/recovered.edits/9.seqid 2023-09-26 07:01:49,073 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemState/55dacdbb0f83b51b8b2487a61c580660/recovered.edits/9.seqid to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemState/55dacdbb0f83b51b8b2487a61c580660/recovered.edits/9.seqid 2023-09-26 07:01:49,074 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemState/ac48292833522927716554c6880d3acb 2023-09-26 07:01:49,074 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemState/55dacdbb0f83b51b8b2487a61c580660 2023-09-26 07:01:49,074 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-26 07:01:49,074 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-26 07:01:49,075 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-26 07:01:49,080 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230926bc1812ac4205451fbdc90a71af643a54 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230926bc1812ac4205451fbdc90a71af643a54 2023-09-26 07:01:49,082 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309267c9d1082b4fa4af9b0706c2dd0b2e6ec to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309267c9d1082b4fa4af9b0706c2dd0b2e6ec 2023-09-26 07:01:49,082 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-26 07:01:49,085 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-26 07:01:49,088 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-26 07:01:49,091 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-26 07:01:49,092 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-26 07:01:49,092 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-26 07:01:49,092 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695711709092"}]},"ts":"9223372036854775807"} 2023-09-26 07:01:49,092 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695711709092"}]},"ts":"9223372036854775807"} 2023-09-26 07:01:49,095 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-26 07:01:49,095 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 55dacdbb0f83b51b8b2487a61c580660, NAME => 'testtb-testExportFileSystemState,,1695711692609.55dacdbb0f83b51b8b2487a61c580660.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ac48292833522927716554c6880d3acb, NAME => 'testtb-testExportFileSystemState,1,1695711692609.ac48292833522927716554c6880d3acb.', STARTKEY => '1', ENDKEY => ''}] 2023-09-26 07:01:49,095 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-26 07:01:49,095 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695711709095"}]},"ts":"9223372036854775807"} 2023-09-26 07:01:49,097 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-26 07:01:49,099 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-26 07:01:49,101 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 59 msec 2023-09-26 07:01:49,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-26 07:01:49,155 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-26 07:01:49,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-26 07:01:49,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-26 07:01:49,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-26 07:01:49,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-26 07:01:49,197 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=763 (was 753) Potentially hanging thread: hconnection-0x354067f6-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1415396038_1 at /127.0.0.1:56010 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2080754119_17 at /127.0.0.1:56032 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1472867783_17 at /127.0.0.1:60156 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x354067f6-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1415396038_1 at /127.0.0.1:33292 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2080754119_17 at /127.0.0.1:33322 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x354067f6-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x354067f6-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1967 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (631867414) connection to jenkins-hbase4.apache.org/172.31.14.131:39903 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (631867414) connection to jenkins-hbase4.apache.org/172.31.14.131:44301 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=934 (was 925) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=244 (was 256), ProcessCount=168 (was 168), AvailableMemoryMB=4526 (was 4681) 2023-09-26 07:01:49,197 WARN [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-26 07:01:49,217 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=763, OpenFileDescriptor=934, MaxFileDescriptor=60000, SystemLoadAverage=244, ProcessCount=168, AvailableMemoryMB=4526 2023-09-26 07:01:49,217 WARN [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-26 07:01:49,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-26 07:01:49,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-26 07:01:49,223 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-26 07:01:49,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-26 07:01:49,224 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-26 07:01:49,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-26 07:01:49,227 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testConsecutiveExports/07bc5bc522c1f2aba826dd96acc6df78 2023-09-26 07:01:49,227 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testConsecutiveExports/87bbc58b6d786b0219a17113d6bd1107 2023-09-26 07:01:49,228 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testConsecutiveExports/07bc5bc522c1f2aba826dd96acc6df78 empty. 2023-09-26 07:01:49,228 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testConsecutiveExports/87bbc58b6d786b0219a17113d6bd1107 empty. 2023-09-26 07:01:49,228 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testConsecutiveExports/07bc5bc522c1f2aba826dd96acc6df78 2023-09-26 07:01:49,228 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testConsecutiveExports/87bbc58b6d786b0219a17113d6bd1107 2023-09-26 07:01:49,228 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-26 07:01:49,242 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-26 07:01:49,243 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 07bc5bc522c1f2aba826dd96acc6df78, NAME => 'testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp 2023-09-26 07:01:49,244 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 87bbc58b6d786b0219a17113d6bd1107, NAME => 'testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp 2023-09-26 07:01:49,256 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:01:49,256 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 87bbc58b6d786b0219a17113d6bd1107, disabling compactions & flushes 2023-09-26 07:01:49,256 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107. 2023-09-26 07:01:49,256 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107. 2023-09-26 07:01:49,256 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107. after waiting 0 ms 2023-09-26 07:01:49,256 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107. 2023-09-26 07:01:49,256 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107. 2023-09-26 07:01:49,256 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 87bbc58b6d786b0219a17113d6bd1107: 2023-09-26 07:01:49,257 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:01:49,257 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 07bc5bc522c1f2aba826dd96acc6df78, disabling compactions & flushes 2023-09-26 07:01:49,257 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. 2023-09-26 07:01:49,257 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. 2023-09-26 07:01:49,257 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. after waiting 0 ms 2023-09-26 07:01:49,257 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. 2023-09-26 07:01:49,257 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. 2023-09-26 07:01:49,257 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 07bc5bc522c1f2aba826dd96acc6df78: 2023-09-26 07:01:49,260 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-26 07:01:49,261 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695711709261"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711709261"}]},"ts":"1695711709261"} 2023-09-26 07:01:49,261 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695711709261"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711709261"}]},"ts":"1695711709261"} 2023-09-26 07:01:49,264 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-26 07:01:49,265 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-26 07:01:49,265 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711709265"}]},"ts":"1695711709265"} 2023-09-26 07:01:49,266 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-26 07:01:49,271 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-26 07:01:49,272 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-26 07:01:49,272 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-26 07:01:49,272 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-26 07:01:49,272 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-26 07:01:49,272 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=07bc5bc522c1f2aba826dd96acc6df78, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=87bbc58b6d786b0219a17113d6bd1107, ASSIGN}] 2023-09-26 07:01:49,275 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=07bc5bc522c1f2aba826dd96acc6df78, ASSIGN 2023-09-26 07:01:49,275 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=87bbc58b6d786b0219a17113d6bd1107, ASSIGN 2023-09-26 07:01:49,276 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=87bbc58b6d786b0219a17113d6bd1107, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39873,1695711667206; forceNewPlan=false, retain=false 2023-09-26 07:01:49,276 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=07bc5bc522c1f2aba826dd96acc6df78, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42373,1695711667152; forceNewPlan=false, retain=false 2023-09-26 07:01:49,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-26 07:01:49,426 INFO [jenkins-hbase4:38147] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-26 07:01:49,429 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=87bbc58b6d786b0219a17113d6bd1107, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:49,429 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=07bc5bc522c1f2aba826dd96acc6df78, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:49,429 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695711709429"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711709429"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711709429"}]},"ts":"1695711709429"} 2023-09-26 07:01:49,429 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695711709429"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711709429"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711709429"}]},"ts":"1695711709429"} 2023-09-26 07:01:49,431 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 87bbc58b6d786b0219a17113d6bd1107, server=jenkins-hbase4.apache.org,39873,1695711667206}] 2023-09-26 07:01:49,432 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 07bc5bc522c1f2aba826dd96acc6df78, server=jenkins-hbase4.apache.org,42373,1695711667152}] 2023-09-26 07:01:49,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-26 07:01:49,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107. 2023-09-26 07:01:49,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 87bbc58b6d786b0219a17113d6bd1107, NAME => 'testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107.', STARTKEY => '1', ENDKEY => ''} 2023-09-26 07:01:49,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107. service=AccessControlService 2023-09-26 07:01:49,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 07:01:49,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. 2023-09-26 07:01:49,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 07bc5bc522c1f2aba826dd96acc6df78, NAME => 'testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78.', STARTKEY => '', ENDKEY => '1'} 2023-09-26 07:01:49,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 87bbc58b6d786b0219a17113d6bd1107 2023-09-26 07:01:49,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:01:49,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 87bbc58b6d786b0219a17113d6bd1107 2023-09-26 07:01:49,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 87bbc58b6d786b0219a17113d6bd1107 2023-09-26 07:01:49,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. service=AccessControlService 2023-09-26 07:01:49,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 07:01:49,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 07bc5bc522c1f2aba826dd96acc6df78 2023-09-26 07:01:49,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:01:49,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 07bc5bc522c1f2aba826dd96acc6df78 2023-09-26 07:01:49,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 07bc5bc522c1f2aba826dd96acc6df78 2023-09-26 07:01:49,592 INFO [StoreOpener-87bbc58b6d786b0219a17113d6bd1107-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 87bbc58b6d786b0219a17113d6bd1107 2023-09-26 07:01:49,593 INFO [StoreOpener-07bc5bc522c1f2aba826dd96acc6df78-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 07bc5bc522c1f2aba826dd96acc6df78 2023-09-26 07:01:49,594 DEBUG [StoreOpener-87bbc58b6d786b0219a17113d6bd1107-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/87bbc58b6d786b0219a17113d6bd1107/cf 2023-09-26 07:01:49,594 DEBUG [StoreOpener-07bc5bc522c1f2aba826dd96acc6df78-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/07bc5bc522c1f2aba826dd96acc6df78/cf 2023-09-26 07:01:49,594 DEBUG [StoreOpener-87bbc58b6d786b0219a17113d6bd1107-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/87bbc58b6d786b0219a17113d6bd1107/cf 2023-09-26 07:01:49,594 DEBUG [StoreOpener-07bc5bc522c1f2aba826dd96acc6df78-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/07bc5bc522c1f2aba826dd96acc6df78/cf 2023-09-26 07:01:49,594 INFO [StoreOpener-07bc5bc522c1f2aba826dd96acc6df78-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07bc5bc522c1f2aba826dd96acc6df78 columnFamilyName cf 2023-09-26 07:01:49,594 INFO [StoreOpener-87bbc58b6d786b0219a17113d6bd1107-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87bbc58b6d786b0219a17113d6bd1107 columnFamilyName cf 2023-09-26 07:01:49,596 INFO [StoreOpener-87bbc58b6d786b0219a17113d6bd1107-1] regionserver.HStore(310): Store=87bbc58b6d786b0219a17113d6bd1107/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:01:49,596 INFO [StoreOpener-07bc5bc522c1f2aba826dd96acc6df78-1] regionserver.HStore(310): Store=07bc5bc522c1f2aba826dd96acc6df78/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:01:49,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/87bbc58b6d786b0219a17113d6bd1107 2023-09-26 07:01:49,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/07bc5bc522c1f2aba826dd96acc6df78 2023-09-26 07:01:49,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/87bbc58b6d786b0219a17113d6bd1107 2023-09-26 07:01:49,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/07bc5bc522c1f2aba826dd96acc6df78 2023-09-26 07:01:49,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 87bbc58b6d786b0219a17113d6bd1107 2023-09-26 07:01:49,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 07bc5bc522c1f2aba826dd96acc6df78 2023-09-26 07:01:49,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/87bbc58b6d786b0219a17113d6bd1107/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 07:01:49,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/07bc5bc522c1f2aba826dd96acc6df78/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 07:01:49,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 87bbc58b6d786b0219a17113d6bd1107; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67466975, jitterRate=0.005336269736289978}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 07:01:49,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 87bbc58b6d786b0219a17113d6bd1107: 2023-09-26 07:01:49,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 07bc5bc522c1f2aba826dd96acc6df78; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64495852, jitterRate=-0.03893691301345825}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 07:01:49,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 07bc5bc522c1f2aba826dd96acc6df78: 2023-09-26 07:01:49,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78., pid=46, masterSystemTime=1695711709584 2023-09-26 07:01:49,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107., pid=45, masterSystemTime=1695711709583 2023-09-26 07:01:49,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. 2023-09-26 07:01:49,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. 2023-09-26 07:01:49,607 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=07bc5bc522c1f2aba826dd96acc6df78, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:49,607 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695711709606"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695711709606"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695711709606"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695711709606"}]},"ts":"1695711709606"} 2023-09-26 07:01:49,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107. 2023-09-26 07:01:49,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107. 2023-09-26 07:01:49,607 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=87bbc58b6d786b0219a17113d6bd1107, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:49,608 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695711709607"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695711709607"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695711709607"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695711709607"}]},"ts":"1695711709607"} 2023-09-26 07:01:49,611 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-09-26 07:01:49,611 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 07bc5bc522c1f2aba826dd96acc6df78, server=jenkins-hbase4.apache.org,42373,1695711667152 in 177 msec 2023-09-26 07:01:49,612 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-09-26 07:01:49,612 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 87bbc58b6d786b0219a17113d6bd1107, server=jenkins-hbase4.apache.org,39873,1695711667206 in 179 msec 2023-09-26 07:01:49,613 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=07bc5bc522c1f2aba826dd96acc6df78, ASSIGN in 339 msec 2023-09-26 07:01:49,615 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-26 07:01:49,615 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=87bbc58b6d786b0219a17113d6bd1107, ASSIGN in 340 msec 2023-09-26 07:01:49,615 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-26 07:01:49,615 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711709615"}]},"ts":"1695711709615"} 2023-09-26 07:01:49,617 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-26 07:01:49,619 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-26 07:01:49,620 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-26 07:01:49,621 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39873] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-26 07:01:49,623 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:01:49,623 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:01:49,623 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:01:49,623 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:01:49,626 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-26 07:01:49,626 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-26 07:01:49,626 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-26 07:01:49,627 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-26 07:01:49,627 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 407 msec 2023-09-26 07:01:49,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-26 07:01:49,829 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-26 07:01:49,831 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-26 07:01:49,831 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. 2023-09-26 07:01:49,833 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 07:01:49,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-26 07:01:49,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695711709845 (current time:1695711709845). 2023-09-26 07:01:49,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 07:01:49,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x712b49d6 to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:01:49,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@123b278, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:01:49,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:49,857 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46684, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:01:49,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x712b49d6 to 127.0.0.1:50261 2023-09-26 07:01:49,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:01:49,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x13472f6f to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:01:49,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3889b128, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:01:49,866 DEBUG [hconnection-0x24256433-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:49,869 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:01:49,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:49,875 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56324, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:01:49,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13472f6f to 127.0.0.1:50261 2023-09-26 07:01:49,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:01:49,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-26 07:01:49,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 07:01:49,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-26 07:01:49,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-26 07:01:49,881 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-26 07:01:49,882 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695712309882 2023-09-26 07:01:49,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-26 07:01:49,882 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-26 07:01:49,883 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 07:01:49,884 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 07:01:49,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-26 07:01:49,885 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-26 07:01:49,886 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-26 07:01:49,887 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-26 07:01:49,888 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695712309888 2023-09-26 07:01:49,904 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,904 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-26 07:01:49,904 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:49,905 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-26 07:01:49,905 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-26 07:01:49,906 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,906 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,907 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:49,907 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:49,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:49,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:49,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:49,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:49,907 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:49,907 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:49,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:49,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:49,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,908 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:49,908 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:49,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,909 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:49,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,909 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 07:01:49,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-26 07:01:49,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-26 07:01:49,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-26 07:01:49,910 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-26 07:01:49,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,910 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-26 07:01:49,910 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-26 07:01:49,910 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,910 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-26 07:01:49,910 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:49,910 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,910 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-26 07:01:49,910 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:49,912 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-26 07:01:49,912 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-26 07:01:49,912 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-26 07:01:49,912 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-26 07:01:49,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,912 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39873,1695711667206' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-26 07:01:49,912 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-26 07:01:49,912 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:49,912 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42373,1695711667152' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-26 07:01:49,916 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-26 07:01:49,916 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-26 07:01:49,916 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32791,1695711667250' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-26 07:01:49,917 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:49,917 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:49,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:49,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:49,918 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:49,918 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:49,918 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,918 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:01:49,918 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,918 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,918 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:01:49,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:49,918 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,918 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:01:49,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:49,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:49,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:49,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:49,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39873,1695711667206' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-26 07:01:49,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a5b3e79[Count = 1] remaining members to acquire global barrier 2023-09-26 07:01:49,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:49,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:49,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:49,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:49,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:49,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:49,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:49,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:49,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:49,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42373,1695711667152' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-26 07:01:49,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a5b3e79[Count = 0] remaining members to acquire global barrier 2023-09-26 07:01:49,922 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-26 07:01:49,922 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,924 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,924 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,924 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,925 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-26 07:01:49,925 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-26 07:01:49,924 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-26 07:01:49,925 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,32791,1695711667250' in zk 2023-09-26 07:01:49,925 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-26 07:01:49,925 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:49,925 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:01:49,925 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:01:49,925 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. 2023-09-26 07:01:49,925 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:01:49,925 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:49,925 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 07:01:49,925 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. started... 2023-09-26 07:01:49,925 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107. 2023-09-26 07:01:49,925 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:01:49,925 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107. started... 2023-09-26 07:01:49,926 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 07bc5bc522c1f2aba826dd96acc6df78: 2023-09-26 07:01:49,927 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 87bbc58b6d786b0219a17113d6bd1107: 2023-09-26 07:01:49,927 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,927 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,927 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:01:49,927 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:01:49,927 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 07:01:49,927 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 07:01:49,932 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-26 07:01:49,932 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:49,932 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-26 07:01:49,937 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. completed. 2023-09-26 07:01:49,937 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. 2023-09-26 07:01:49,937 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:01:49,937 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:01:49,937 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107. completed. 2023-09-26 07:01:49,937 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107. 2023-09-26 07:01:49,937 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:49,937 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:01:49,937 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:01:49,937 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:49,937 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-26 07:01:49,937 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42373,1695711667152' in zk 2023-09-26 07:01:49,937 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-26 07:01:49,938 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39873,1695711667206' in zk 2023-09-26 07:01:49,939 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-26 07:01:49,939 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:49,939 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:49,939 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-26 07:01:49,940 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:49,939 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-26 07:01:49,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:49,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:49,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:49,940 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:49,940 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-26 07:01:49,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:49,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:49,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:49,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:49,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:49,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:49,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:49,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:49,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:49,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42373,1695711667152': 2023-09-26 07:01:49,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42373,1695711667152' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-26 07:01:49,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:49,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:49,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:49,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:49,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:49,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:49,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:49,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:49,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:49,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:49,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:49,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:49,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39873,1695711667206': 2023-09-26 07:01:49,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39873,1695711667206' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-26 07:01:49,948 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-26 07:01:49,948 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 07:01:49,948 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 07:01:49,948 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,948 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 07:01:49,950 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,950 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,950 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,950 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:49,950 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,950 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:49,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,950 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:49,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,950 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:49,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:49,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:49,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:49,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:49,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:49,951 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:49,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:49,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:49,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:49,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:49,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,951 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:49,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:49,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:49,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:49,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:49,953 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:49,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:49,953 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:49,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,954 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:49,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:49,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:49,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:49,956 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:49,956 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,956 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:49,956 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:49,956 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:49,957 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:49,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:49,957 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:49,957 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,957 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:49,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:49,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:49,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:49,956 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:49,956 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:49,958 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:49,958 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:49,958 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-26 07:01:49,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:49,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:49,958 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:49,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:49,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:49,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 07:01:49,959 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:49,959 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:49,959 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:49,959 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,959 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:49,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:49,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-26 07:01:49,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,984 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:01:49,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-26 07:01:49,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-26 07:01:49,985 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 07:01:49,987 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,987 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-26 07:01:49,987 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,988 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-26 07:01:49,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695711709882Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695711709969 (+87 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695711709969Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695711709969Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695711709973 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695711709981 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695711709987 (+6 ms) 2023-09-26 07:01:49,991 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-26 07:01:49,992 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 108 msec 2023-09-26 07:01:50,185 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:01:50,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-26 07:01:50,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 07:01:50,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42373] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 07:01:50,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39873] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 07:01:50,194 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-26 07:01:50,194 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. 2023-09-26 07:01:50,194 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 07:01:50,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-26 07:01:50,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695711710206 (current time:1695711710206). 2023-09-26 07:01:50,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 07:01:50,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x3df00fa3 to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:01:50,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48b22209, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:01:50,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:50,223 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:01:50,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3df00fa3 to 127.0.0.1:50261 2023-09-26 07:01:50,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:01:50,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x7c3a92f0 to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:01:50,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4858962f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:01:50,235 DEBUG [hconnection-0x5e830d7a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:50,236 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46716, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:01:50,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:01:50,243 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56326, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:01:50,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c3a92f0 to 127.0.0.1:50261 2023-09-26 07:01:50,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:01:50,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-26 07:01:50,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 07:01:50,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-26 07:01:50,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-26 07:01:50,249 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-26 07:01:50,250 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695712310250 2023-09-26 07:01:50,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-26 07:01:50,250 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-26 07:01:50,252 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 07:01:50,252 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 07:01:50,255 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-26 07:01:50,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-26 07:01:50,257 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 10 msec 2023-09-26 07:01:50,258 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-26 07:01:50,259 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695712310259 2023-09-26 07:01:50,273 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-26 07:01:50,273 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-26 07:01:50,273 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:50,275 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-26 07:01:50,275 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-26 07:01:50,275 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,275 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,277 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:50,277 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:50,277 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:50,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:50,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:50,277 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:50,277 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:50,277 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:50,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:50,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:50,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:50,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:50,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,278 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:50,278 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 07:01:50,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-26 07:01:50,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-26 07:01:50,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,279 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-26 07:01:50,279 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-26 07:01:50,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-26 07:01:50,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,279 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-26 07:01:50,279 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-26 07:01:50,279 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-26 07:01:50,279 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:50,279 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-26 07:01:50,279 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-26 07:01:50,279 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:50,282 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-26 07:01:50,282 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-26 07:01:50,282 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-26 07:01:50,282 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-26 07:01:50,282 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:01:50,282 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-26 07:01:50,283 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-26 07:01:50,283 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-26 07:01:50,282 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39873,1695711667206' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-26 07:01:50,283 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32791,1695711667250' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-26 07:01:50,283 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-26 07:01:50,283 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42373,1695711667152' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-26 07:01:50,285 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:50,285 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:50,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:50,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:50,286 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:50,286 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,286 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,286 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:01:50,286 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:50,286 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,286 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:01:50,286 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:50,286 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:01:50,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-26 07:01:50,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:50,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:50,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:50,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:50,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39873,1695711667206' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-26 07:01:50,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44c2ebba[Count = 1] remaining members to acquire global barrier 2023-09-26 07:01:50,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:50,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:50,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:50,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:50,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:50,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-26 07:01:50,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:50,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:50,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:50,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:50,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42373,1695711667152' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-26 07:01:50,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44c2ebba[Count = 0] remaining members to acquire global barrier 2023-09-26 07:01:50,290 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-26 07:01:50,290 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,293 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,293 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,293 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,293 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-26 07:01:50,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,293 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:50,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,293 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:01:50,293 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:01:50,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,293 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-26 07:01:50,293 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-26 07:01:50,293 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-26 07:01:50,294 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,32791,1695711667250' in zk 2023-09-26 07:01:50,293 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:50,294 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 07:01:50,294 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:01:50,294 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:01:50,294 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107. 2023-09-26 07:01:50,293 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. 2023-09-26 07:01:50,294 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107. started... 2023-09-26 07:01:50,294 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. started... 2023-09-26 07:01:50,294 INFO [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 07bc5bc522c1f2aba826dd96acc6df78 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-26 07:01:50,294 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 87bbc58b6d786b0219a17113d6bd1107 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-26 07:01:50,295 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-26 07:01:50,295 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:50,296 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-26 07:01:50,331 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230926c3b11f90bbe8461a97ecb7d381434447 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230926c3b11f90bbe8461a97ecb7d381434447 2023-09-26 07:01:50,331 INFO [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230926f452d532feff4c1c981d49f421c9f37f to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230926f452d532feff4c1c981d49f421c9f37f 2023-09-26 07:01:50,339 INFO [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/07bc5bc522c1f2aba826dd96acc6df78/.tmp/cf/c637391e9f9d437ebd375a5ffebbb011 2023-09-26 07:01:50,340 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/87bbc58b6d786b0219a17113d6bd1107/.tmp/cf/df9946eb2fa74f9abbb5555cdd51b391 2023-09-26 07:01:50,345 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/07bc5bc522c1f2aba826dd96acc6df78/.tmp/cf/c637391e9f9d437ebd375a5ffebbb011 as hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/07bc5bc522c1f2aba826dd96acc6df78/cf/c637391e9f9d437ebd375a5ffebbb011 2023-09-26 07:01:50,345 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/87bbc58b6d786b0219a17113d6bd1107/.tmp/cf/df9946eb2fa74f9abbb5555cdd51b391 as hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/87bbc58b6d786b0219a17113d6bd1107/cf/df9946eb2fa74f9abbb5555cdd51b391 2023-09-26 07:01:50,350 INFO [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/07bc5bc522c1f2aba826dd96acc6df78/cf/c637391e9f9d437ebd375a5ffebbb011, entries=5, sequenceid=6, filesize=5.7 K 2023-09-26 07:01:50,350 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/87bbc58b6d786b0219a17113d6bd1107/cf/df9946eb2fa74f9abbb5555cdd51b391, entries=45, sequenceid=6, filesize=12.4 K 2023-09-26 07:01:50,351 INFO [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 07bc5bc522c1f2aba826dd96acc6df78 in 57ms, sequenceid=6, compaction requested=false 2023-09-26 07:01:50,351 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-26 07:01:50,351 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 07bc5bc522c1f2aba826dd96acc6df78: 2023-09-26 07:01:50,351 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 87bbc58b6d786b0219a17113d6bd1107 in 57ms, sequenceid=6, compaction requested=false 2023-09-26 07:01:50,351 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-26 07:01:50,353 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:01:50,353 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 87bbc58b6d786b0219a17113d6bd1107: 2023-09-26 07:01:50,353 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:01:50,353 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/07bc5bc522c1f2aba826dd96acc6df78/cf/c637391e9f9d437ebd375a5ffebbb011] hfiles 2023-09-26 07:01:50,353 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-26 07:01:50,353 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/07bc5bc522c1f2aba826dd96acc6df78/cf/c637391e9f9d437ebd375a5ffebbb011 for snapshot=snaptb0-testConsecutiveExports 2023-09-26 07:01:50,354 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:01:50,354 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/87bbc58b6d786b0219a17113d6bd1107/cf/df9946eb2fa74f9abbb5555cdd51b391] hfiles 2023-09-26 07:01:50,354 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/87bbc58b6d786b0219a17113d6bd1107/cf/df9946eb2fa74f9abbb5555cdd51b391 for snapshot=snaptb0-testConsecutiveExports 2023-09-26 07:01:50,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-26 07:01:50,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-26 07:01:50,355 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 07:01:50,363 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107. completed. 2023-09-26 07:01:50,363 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107. 2023-09-26 07:01:50,363 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:01:50,364 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:01:50,364 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:50,364 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-26 07:01:50,364 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39873,1695711667206' in zk 2023-09-26 07:01:50,366 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. completed. 2023-09-26 07:01:50,366 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. 2023-09-26 07:01:50,366 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:01:50,366 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:01:50,366 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:50,366 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-26 07:01:50,366 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42373,1695711667152' in zk 2023-09-26 07:01:50,368 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:50,368 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-26 07:01:50,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:50,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:50,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:50,368 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:50,368 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-26 07:01:50,370 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-26 07:01:50,370 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:50,370 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:50,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:50,370 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-26 07:01:50,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:50,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-26 07:01:50,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:50,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:50,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:50,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:50,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-26 07:01:50,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:50,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:50,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:50,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42373,1695711667152': 2023-09-26 07:01:50,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42373,1695711667152' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-26 07:01:50,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:50,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:50,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:50,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:50,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:50,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-26 07:01:50,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:50,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:50,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:50,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:50,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-26 07:01:50,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:50,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:50,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:50,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39873,1695711667206': 2023-09-26 07:01:50,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39873,1695711667206' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-26 07:01:50,378 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-26 07:01:50,378 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 07:01:50,378 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 07:01:50,378 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-26 07:01:50,378 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 07:01:50,383 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,383 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:01:50,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:01:50,383 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:50,383 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,383 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,384 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:50,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:01:50,384 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:50,384 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:50,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:50,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:50,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:50,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:50,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-26 07:01:50,385 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:50,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:50,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:50,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:01:50,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,385 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:50,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-26 07:01:50,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:50,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:50,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:50,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:01:50,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-26 07:01:50,389 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:50,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:50,389 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:50,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:50,389 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:50,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:50,400 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:50,400 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:50,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:50,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:50,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:50,400 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:01:50,400 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:01:50,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:01:50,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:50,400 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:50,400 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:50,400 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:50,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:50,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:01:50,400 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-26 07:01:50,400 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:01:50,403 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-26 07:01:50,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:50,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:50,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:01:50,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:50,402 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:01:50,403 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-26 07:01:50,403 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:50,403 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:50,403 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,403 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 07:01:50,403 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:01:50,403 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,403 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:01:50,403 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:01:50,404 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,404 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230926c3b11f90bbe8461a97ecb7d381434447, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230926f452d532feff4c1c981d49f421c9f37f] mob files 2023-09-26 07:01:50,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230926c3b11f90bbe8461a97ecb7d381434447 2023-09-26 07:01:50,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230926f452d532feff4c1c981d49f421c9f37f 2023-09-26 07:01:50,415 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-26 07:01:50,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,434 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-26 07:01:50,434 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,435 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695711710251Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695711710415 (+164 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695711710415Loading Region manifests for snaptb0-testConsecutiveExports at 1695711710415Writing data manifest for snaptb0-testConsecutiveExports at 1695711710419 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695711710426 (+7 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695711710434 (+8 ms) 2023-09-26 07:01:50,437 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-26 07:01:50,439 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 185 msec 2023-09-26 07:01:50,555 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:01:50,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-26 07:01:50,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 07:01:50,556 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/local-export-1695711710556 2023-09-26 07:01:50,557 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/local-export-1695711710556, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/local-export-1695711710556, srcFsUri=hdfs://localhost:36301, srcDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1 2023-09-26 07:01:50,579 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36301, inputRoot=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1 2023-09-26 07:01:50,579 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@1f0f7459, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/local-export-1695711710556, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/local-export-1695711710556/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,579 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36301, inputRoot=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1, snapshotDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-26 07:01:50,588 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/local-export-1695711710556/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-26 07:01:50,599 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:50,600 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:50,600 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:50,600 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:51,483 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/hadoop-7631827558130453351.jar 2023-09-26 07:01:51,484 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:51,484 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:51,552 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/hadoop-6383025666047630589.jar 2023-09-26 07:01:51,552 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:51,553 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:51,553 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:51,554 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:51,554 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:51,554 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-26 07:01:51,555 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-26 07:01:51,555 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-26 07:01:51,555 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-26 07:01:51,556 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-26 07:01:51,556 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-26 07:01:51,557 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-26 07:01:51,557 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-26 07:01:51,557 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-26 07:01:51,557 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-26 07:01:51,558 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-26 07:01:51,559 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:01:51,559 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:01:51,560 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 07:01:51,560 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:01:51,560 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:01:51,561 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 07:01:51,561 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 07:01:51,928 WARN [Listener at jenkins-hbase4.apache.org/41375] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-26 07:01:51,930 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-26 07:01:51,932 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-26 07:01:53,204 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 07:01:53,204 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 07:01:53,208 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0002_000001 (auth:SIMPLE) 2023-09-26 07:01:54,006 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0003_000001 (auth:SIMPLE) 2023-09-26 07:01:54,489 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-26 07:01:57,783 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0003_000001 (auth:SIMPLE) 2023-09-26 07:02:00,004 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0003_000001 (auth:SIMPLE) 2023-09-26 07:02:02,397 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0003_000001 (auth:SIMPLE) 2023-09-26 07:02:04,101 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-26 07:02:04,101 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-26 07:02:04,106 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-26 07:02:04,106 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-26 07:02:04,107 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-26 07:02:04,107 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2080754119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-26 07:02:04,110 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-26 07:02:04,110 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-26 07:02:04,110 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@e4130f7 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/local-export-1695711710556/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/local-export-1695711710556/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-26 07:02:04,110 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/local-export-1695711710556/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-26 07:02:04,110 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/local-export-1695711710556/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-26 07:02:04,111 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/local-export-1695711710556, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/local-export-1695711710556, srcFsUri=hdfs://localhost:36301, srcDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1 2023-09-26 07:02:04,134 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36301, inputRoot=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1 2023-09-26 07:02:04,134 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@60de90b5, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/local-export-1695711710556, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/local-export-1695711710556/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-26 07:02:04,134 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36301, inputRoot=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1, snapshotDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-26 07:02:04,146 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/local-export-1695711710556/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-26 07:02:04,157 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:04,157 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:04,158 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:04,158 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:05,032 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/hadoop-8019732664500826177.jar 2023-09-26 07:02:05,033 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:05,033 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:05,099 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/hadoop-2606883536656446585.jar 2023-09-26 07:02:05,100 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:05,100 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:05,101 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:05,101 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:05,101 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:05,102 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:05,102 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-26 07:02:05,102 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-26 07:02:05,103 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-26 07:02:05,103 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-26 07:02:05,103 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-26 07:02:05,104 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-26 07:02:05,104 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-26 07:02:05,105 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-26 07:02:05,105 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-26 07:02:05,106 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-26 07:02:05,106 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:02:05,106 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:02:05,107 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 07:02:05,107 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:02:05,107 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:02:05,108 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 07:02:05,108 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 07:02:05,498 WARN [Listener at jenkins-hbase4.apache.org/41375] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-26 07:02:05,501 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-26 07:02:05,503 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-26 07:02:08,571 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 07:02:08,571 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 07:02:08,574 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0003_000001 (auth:SIMPLE) 2023-09-26 07:02:09,216 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0004_000001 (auth:SIMPLE) 2023-09-26 07:02:13,049 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0004_000001 (auth:SIMPLE) 2023-09-26 07:02:15,277 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0004_000001 (auth:SIMPLE) 2023-09-26 07:02:17,517 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0004_000001 (auth:SIMPLE) 2023-09-26 07:02:18,662 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-26 07:02:18,663 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-26 07:02:18,666 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-26 07:02:18,667 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-26 07:02:18,667 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-26 07:02:18,667 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2080754119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-26 07:02:18,671 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-26 07:02:18,671 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-26 07:02:18,671 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@e4130f7 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/local-export-1695711710556/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/local-export-1695711710556/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-26 07:02:18,672 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/local-export-1695711710556/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-26 07:02:18,672 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/local-export-1695711710556/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-26 07:02:18,684 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-26 07:02:18,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-26 07:02:18,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-26 07:02:18,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-26 07:02:18,689 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711738688"}]},"ts":"1695711738688"} 2023-09-26 07:02:18,690 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-26 07:02:18,693 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-26 07:02:18,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=07bc5bc522c1f2aba826dd96acc6df78, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=87bbc58b6d786b0219a17113d6bd1107, UNASSIGN}] 2023-09-26 07:02:18,696 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=07bc5bc522c1f2aba826dd96acc6df78, UNASSIGN 2023-09-26 07:02:18,696 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=87bbc58b6d786b0219a17113d6bd1107, UNASSIGN 2023-09-26 07:02:18,696 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=07bc5bc522c1f2aba826dd96acc6df78, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:18,697 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695711738696"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711738696"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711738696"}]},"ts":"1695711738696"} 2023-09-26 07:02:18,697 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=87bbc58b6d786b0219a17113d6bd1107, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:18,697 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695711738697"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711738697"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711738697"}]},"ts":"1695711738697"} 2023-09-26 07:02:18,698 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 07bc5bc522c1f2aba826dd96acc6df78, server=jenkins-hbase4.apache.org,42373,1695711667152}] 2023-09-26 07:02:18,699 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 87bbc58b6d786b0219a17113d6bd1107, server=jenkins-hbase4.apache.org,39873,1695711667206}] 2023-09-26 07:02:18,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-26 07:02:18,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 07bc5bc522c1f2aba826dd96acc6df78 2023-09-26 07:02:18,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 07bc5bc522c1f2aba826dd96acc6df78, disabling compactions & flushes 2023-09-26 07:02:18,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. 2023-09-26 07:02:18,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. 2023-09-26 07:02:18,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. after waiting 0 ms 2023-09-26 07:02:18,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. 2023-09-26 07:02:18,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 87bbc58b6d786b0219a17113d6bd1107 2023-09-26 07:02:18,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 87bbc58b6d786b0219a17113d6bd1107, disabling compactions & flushes 2023-09-26 07:02:18,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107. 2023-09-26 07:02:18,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107. 2023-09-26 07:02:18,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107. after waiting 0 ms 2023-09-26 07:02:18,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107. 2023-09-26 07:02:18,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/07bc5bc522c1f2aba826dd96acc6df78/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 07:02:18,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testConsecutiveExports/87bbc58b6d786b0219a17113d6bd1107/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 07:02:18,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:02:18,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78. 2023-09-26 07:02:18,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 07bc5bc522c1f2aba826dd96acc6df78: 2023-09-26 07:02:18,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:02:18,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107. 2023-09-26 07:02:18,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 87bbc58b6d786b0219a17113d6bd1107: 2023-09-26 07:02:18,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 07bc5bc522c1f2aba826dd96acc6df78 2023-09-26 07:02:18,870 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=07bc5bc522c1f2aba826dd96acc6df78, regionState=CLOSED 2023-09-26 07:02:18,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 87bbc58b6d786b0219a17113d6bd1107 2023-09-26 07:02:18,870 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695711738870"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711738870"}]},"ts":"1695711738870"} 2023-09-26 07:02:18,871 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=87bbc58b6d786b0219a17113d6bd1107, regionState=CLOSED 2023-09-26 07:02:18,871 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695711738870"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711738870"}]},"ts":"1695711738870"} 2023-09-26 07:02:18,873 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-26 07:02:18,873 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 07bc5bc522c1f2aba826dd96acc6df78, server=jenkins-hbase4.apache.org,42373,1695711667152 in 173 msec 2023-09-26 07:02:18,874 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-26 07:02:18,874 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 87bbc58b6d786b0219a17113d6bd1107, server=jenkins-hbase4.apache.org,39873,1695711667206 in 173 msec 2023-09-26 07:02:18,874 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=07bc5bc522c1f2aba826dd96acc6df78, UNASSIGN in 180 msec 2023-09-26 07:02:18,876 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-26 07:02:18,876 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=87bbc58b6d786b0219a17113d6bd1107, UNASSIGN in 181 msec 2023-09-26 07:02:18,876 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711738876"}]},"ts":"1695711738876"} 2023-09-26 07:02:18,877 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-26 07:02:18,879 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-26 07:02:18,881 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 196 msec 2023-09-26 07:02:18,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-26 07:02:18,990 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-26 07:02:18,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-26 07:02:18,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-26 07:02:18,994 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-26 07:02:18,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-26 07:02:18,995 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-26 07:02:18,998 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39873] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-26 07:02:19,001 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-26 07:02:19,001 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-26 07:02:19,002 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-26 07:02:19,001 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-26 07:02:19,002 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testConsecutiveExports/07bc5bc522c1f2aba826dd96acc6df78 2023-09-26 07:02:19,002 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testConsecutiveExports/87bbc58b6d786b0219a17113d6bd1107 2023-09-26 07:02:19,002 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-26 07:02:19,003 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-26 07:02:19,003 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-26 07:02:19,003 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-26 07:02:19,004 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-26 07:02:19,004 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-26 07:02:19,004 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-26 07:02:19,004 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-26 07:02:19,004 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:19,004 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:19,004 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testConsecutiveExports/87bbc58b6d786b0219a17113d6bd1107/cf, FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testConsecutiveExports/87bbc58b6d786b0219a17113d6bd1107/recovered.edits] 2023-09-26 07:02:19,004 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:19,004 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:19,005 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testConsecutiveExports/07bc5bc522c1f2aba826dd96acc6df78/cf, FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testConsecutiveExports/07bc5bc522c1f2aba826dd96acc6df78/recovered.edits] 2023-09-26 07:02:19,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-26 07:02:19,013 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testConsecutiveExports/87bbc58b6d786b0219a17113d6bd1107/cf/df9946eb2fa74f9abbb5555cdd51b391 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testConsecutiveExports/87bbc58b6d786b0219a17113d6bd1107/cf/df9946eb2fa74f9abbb5555cdd51b391 2023-09-26 07:02:19,013 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testConsecutiveExports/07bc5bc522c1f2aba826dd96acc6df78/cf/c637391e9f9d437ebd375a5ffebbb011 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testConsecutiveExports/07bc5bc522c1f2aba826dd96acc6df78/cf/c637391e9f9d437ebd375a5ffebbb011 2023-09-26 07:02:19,016 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testConsecutiveExports/87bbc58b6d786b0219a17113d6bd1107/recovered.edits/9.seqid to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testConsecutiveExports/87bbc58b6d786b0219a17113d6bd1107/recovered.edits/9.seqid 2023-09-26 07:02:19,017 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testConsecutiveExports/07bc5bc522c1f2aba826dd96acc6df78/recovered.edits/9.seqid to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testConsecutiveExports/07bc5bc522c1f2aba826dd96acc6df78/recovered.edits/9.seqid 2023-09-26 07:02:19,017 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testConsecutiveExports/87bbc58b6d786b0219a17113d6bd1107 2023-09-26 07:02:19,017 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testConsecutiveExports/07bc5bc522c1f2aba826dd96acc6df78 2023-09-26 07:02:19,017 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-26 07:02:19,018 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-26 07:02:19,019 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-26 07:02:19,022 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230926c3b11f90bbe8461a97ecb7d381434447 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230926c3b11f90bbe8461a97ecb7d381434447 2023-09-26 07:02:19,023 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230926f452d532feff4c1c981d49f421c9f37f to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230926f452d532feff4c1c981d49f421c9f37f 2023-09-26 07:02:19,024 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-26 07:02:19,026 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-26 07:02:19,028 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-26 07:02:19,030 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-26 07:02:19,031 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-26 07:02:19,031 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-26 07:02:19,032 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695711739031"}]},"ts":"9223372036854775807"} 2023-09-26 07:02:19,032 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695711739031"}]},"ts":"9223372036854775807"} 2023-09-26 07:02:19,034 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-26 07:02:19,034 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 07bc5bc522c1f2aba826dd96acc6df78, NAME => 'testtb-testConsecutiveExports,,1695711709219.07bc5bc522c1f2aba826dd96acc6df78.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 87bbc58b6d786b0219a17113d6bd1107, NAME => 'testtb-testConsecutiveExports,1,1695711709219.87bbc58b6d786b0219a17113d6bd1107.', STARTKEY => '1', ENDKEY => ''}] 2023-09-26 07:02:19,034 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-26 07:02:19,034 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695711739034"}]},"ts":"9223372036854775807"} 2023-09-26 07:02:19,036 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-26 07:02:19,038 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-26 07:02:19,040 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 47 msec 2023-09-26 07:02:19,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-26 07:02:19,111 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-26 07:02:19,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-26 07:02:19,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-26 07:02:19,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-26 07:02:19,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-26 07:02:19,153 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=750 (was 763), OpenFileDescriptor=904 (was 934), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=200 (was 244), ProcessCount=168 (was 168), AvailableMemoryMB=4428 (was 4526) 2023-09-26 07:02:19,153 WARN [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-09-26 07:02:19,173 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=750, OpenFileDescriptor=904, MaxFileDescriptor=60000, SystemLoadAverage=200, ProcessCount=168, AvailableMemoryMB=4427 2023-09-26 07:02:19,173 WARN [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-09-26 07:02:19,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-26 07:02:19,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,179 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-26 07:02:19,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-26 07:02:19,179 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-26 07:02:19,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-26 07:02:19,182 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/68728829bb43a43e00ff99e719792c51 2023-09-26 07:02:19,182 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/143c0e4b33273307e7d01f9c2d825450 2023-09-26 07:02:19,183 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/68728829bb43a43e00ff99e719792c51 empty. 2023-09-26 07:02:19,183 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/143c0e4b33273307e7d01f9c2d825450 empty. 2023-09-26 07:02:19,183 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/68728829bb43a43e00ff99e719792c51 2023-09-26 07:02:19,183 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/143c0e4b33273307e7d01f9c2d825450 2023-09-26 07:02:19,183 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-26 07:02:19,193 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-26 07:02:19,194 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 68728829bb43a43e00ff99e719792c51, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp 2023-09-26 07:02:19,195 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 143c0e4b33273307e7d01f9c2d825450, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp 2023-09-26 07:02:19,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:02:19,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:02:19,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 143c0e4b33273307e7d01f9c2d825450, disabling compactions & flushes 2023-09-26 07:02:19,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 68728829bb43a43e00ff99e719792c51, disabling compactions & flushes 2023-09-26 07:02:19,205 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450. 2023-09-26 07:02:19,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450. 2023-09-26 07:02:19,205 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. 2023-09-26 07:02:19,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450. after waiting 0 ms 2023-09-26 07:02:19,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450. 2023-09-26 07:02:19,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. 2023-09-26 07:02:19,205 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450. 2023-09-26 07:02:19,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. after waiting 0 ms 2023-09-26 07:02:19,206 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 143c0e4b33273307e7d01f9c2d825450: 2023-09-26 07:02:19,206 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. 2023-09-26 07:02:19,206 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. 2023-09-26 07:02:19,206 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 68728829bb43a43e00ff99e719792c51: 2023-09-26 07:02:19,208 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-26 07:02:19,209 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695711739209"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711739209"}]},"ts":"1695711739209"} 2023-09-26 07:02:19,209 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695711739209"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711739209"}]},"ts":"1695711739209"} 2023-09-26 07:02:19,216 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-26 07:02:19,217 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-26 07:02:19,217 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711739217"}]},"ts":"1695711739217"} 2023-09-26 07:02:19,219 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-26 07:02:19,222 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-26 07:02:19,223 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-26 07:02:19,223 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-26 07:02:19,223 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-26 07:02:19,223 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-26 07:02:19,224 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=68728829bb43a43e00ff99e719792c51, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=143c0e4b33273307e7d01f9c2d825450, ASSIGN}] 2023-09-26 07:02:19,226 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=143c0e4b33273307e7d01f9c2d825450, ASSIGN 2023-09-26 07:02:19,226 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=68728829bb43a43e00ff99e719792c51, ASSIGN 2023-09-26 07:02:19,227 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=143c0e4b33273307e7d01f9c2d825450, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32791,1695711667250; forceNewPlan=false, retain=false 2023-09-26 07:02:19,227 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=68728829bb43a43e00ff99e719792c51, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39873,1695711667206; forceNewPlan=false, retain=false 2023-09-26 07:02:19,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-26 07:02:19,377 INFO [jenkins-hbase4:38147] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-26 07:02:19,380 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=143c0e4b33273307e7d01f9c2d825450, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:19,380 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=68728829bb43a43e00ff99e719792c51, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:19,380 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695711739380"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711739380"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711739380"}]},"ts":"1695711739380"} 2023-09-26 07:02:19,380 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695711739380"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711739380"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711739380"}]},"ts":"1695711739380"} 2023-09-26 07:02:19,382 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 143c0e4b33273307e7d01f9c2d825450, server=jenkins-hbase4.apache.org,32791,1695711667250}] 2023-09-26 07:02:19,383 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 68728829bb43a43e00ff99e719792c51, server=jenkins-hbase4.apache.org,39873,1695711667206}] 2023-09-26 07:02:19,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-26 07:02:19,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. 2023-09-26 07:02:19,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450. 2023-09-26 07:02:19,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 68728829bb43a43e00ff99e719792c51, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51.', STARTKEY => '', ENDKEY => '1'} 2023-09-26 07:02:19,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 143c0e4b33273307e7d01f9c2d825450, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450.', STARTKEY => '1', ENDKEY => ''} 2023-09-26 07:02:19,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. service=AccessControlService 2023-09-26 07:02:19,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450. service=AccessControlService 2023-09-26 07:02:19,541 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 07:02:19,541 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 07:02:19,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 68728829bb43a43e00ff99e719792c51 2023-09-26 07:02:19,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 143c0e4b33273307e7d01f9c2d825450 2023-09-26 07:02:19,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:02:19,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:02:19,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 68728829bb43a43e00ff99e719792c51 2023-09-26 07:02:19,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 143c0e4b33273307e7d01f9c2d825450 2023-09-26 07:02:19,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 68728829bb43a43e00ff99e719792c51 2023-09-26 07:02:19,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 143c0e4b33273307e7d01f9c2d825450 2023-09-26 07:02:19,543 INFO [StoreOpener-143c0e4b33273307e7d01f9c2d825450-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 143c0e4b33273307e7d01f9c2d825450 2023-09-26 07:02:19,543 INFO [StoreOpener-68728829bb43a43e00ff99e719792c51-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 68728829bb43a43e00ff99e719792c51 2023-09-26 07:02:19,544 DEBUG [StoreOpener-143c0e4b33273307e7d01f9c2d825450-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/143c0e4b33273307e7d01f9c2d825450/cf 2023-09-26 07:02:19,544 DEBUG [StoreOpener-68728829bb43a43e00ff99e719792c51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/68728829bb43a43e00ff99e719792c51/cf 2023-09-26 07:02:19,544 DEBUG [StoreOpener-143c0e4b33273307e7d01f9c2d825450-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/143c0e4b33273307e7d01f9c2d825450/cf 2023-09-26 07:02:19,544 DEBUG [StoreOpener-68728829bb43a43e00ff99e719792c51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/68728829bb43a43e00ff99e719792c51/cf 2023-09-26 07:02:19,545 INFO [StoreOpener-68728829bb43a43e00ff99e719792c51-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68728829bb43a43e00ff99e719792c51 columnFamilyName cf 2023-09-26 07:02:19,545 INFO [StoreOpener-143c0e4b33273307e7d01f9c2d825450-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 143c0e4b33273307e7d01f9c2d825450 columnFamilyName cf 2023-09-26 07:02:19,547 INFO [StoreOpener-143c0e4b33273307e7d01f9c2d825450-1] regionserver.HStore(310): Store=143c0e4b33273307e7d01f9c2d825450/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:02:19,547 INFO [StoreOpener-68728829bb43a43e00ff99e719792c51-1] regionserver.HStore(310): Store=68728829bb43a43e00ff99e719792c51/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:02:19,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/143c0e4b33273307e7d01f9c2d825450 2023-09-26 07:02:19,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/68728829bb43a43e00ff99e719792c51 2023-09-26 07:02:19,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/143c0e4b33273307e7d01f9c2d825450 2023-09-26 07:02:19,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/68728829bb43a43e00ff99e719792c51 2023-09-26 07:02:19,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 143c0e4b33273307e7d01f9c2d825450 2023-09-26 07:02:19,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 68728829bb43a43e00ff99e719792c51 2023-09-26 07:02:19,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/68728829bb43a43e00ff99e719792c51/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 07:02:19,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/143c0e4b33273307e7d01f9c2d825450/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 07:02:19,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 68728829bb43a43e00ff99e719792c51; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63795528, jitterRate=-0.04937255382537842}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 07:02:19,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 68728829bb43a43e00ff99e719792c51: 2023-09-26 07:02:19,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 143c0e4b33273307e7d01f9c2d825450; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68364590, jitterRate=0.018711775541305542}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 07:02:19,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 143c0e4b33273307e7d01f9c2d825450: 2023-09-26 07:02:19,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51., pid=61, masterSystemTime=1695711739535 2023-09-26 07:02:19,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450., pid=60, masterSystemTime=1695711739534 2023-09-26 07:02:19,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. 2023-09-26 07:02:19,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. 2023-09-26 07:02:19,558 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=68728829bb43a43e00ff99e719792c51, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:19,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450. 2023-09-26 07:02:19,559 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695711739558"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695711739558"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695711739558"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695711739558"}]},"ts":"1695711739558"} 2023-09-26 07:02:19,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450. 2023-09-26 07:02:19,559 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=143c0e4b33273307e7d01f9c2d825450, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:19,559 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695711739559"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695711739559"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695711739559"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695711739559"}]},"ts":"1695711739559"} 2023-09-26 07:02:19,563 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-26 07:02:19,563 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 68728829bb43a43e00ff99e719792c51, server=jenkins-hbase4.apache.org,39873,1695711667206 in 178 msec 2023-09-26 07:02:19,564 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-26 07:02:19,564 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=68728829bb43a43e00ff99e719792c51, ASSIGN in 339 msec 2023-09-26 07:02:19,564 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 143c0e4b33273307e7d01f9c2d825450, server=jenkins-hbase4.apache.org,32791,1695711667250 in 180 msec 2023-09-26 07:02:19,566 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-26 07:02:19,566 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=143c0e4b33273307e7d01f9c2d825450, ASSIGN in 340 msec 2023-09-26 07:02:19,567 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-26 07:02:19,567 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711739567"}]},"ts":"1695711739567"} 2023-09-26 07:02:19,568 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-26 07:02:19,572 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-26 07:02:19,572 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-26 07:02:19,574 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39873] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-26 07:02:19,576 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:19,576 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:19,576 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:19,576 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:19,578 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:19,578 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:19,578 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:19,578 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:19,580 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 403 msec 2023-09-26 07:02:19,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-26 07:02:19,783 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-26 07:02:19,785 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,786 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. 2023-09-26 07:02:19,787 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 07:02:19,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-26 07:02:19,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695711739800 (current time:1695711739800). 2023-09-26 07:02:19,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 07:02:19,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x0ad2b610 to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:02:19,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5759d99b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:02:19,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:02:19,810 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:02:19,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ad2b610 to 127.0.0.1:50261 2023-09-26 07:02:19,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:02:19,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x2908629e to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:02:19,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36f52399, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:02:19,819 DEBUG [hconnection-0x2ff9b1dd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:02:19,822 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52278, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:02:19,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:02:19,828 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:02:19,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2908629e to 127.0.0.1:50261 2023-09-26 07:02:19,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:02:19,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-26 07:02:19,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 07:02:19,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-26 07:02:19,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-26 07:02:19,834 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-26 07:02:19,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-26 07:02:19,834 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,834 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695712339834 2023-09-26 07:02:19,835 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 07:02:19,836 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 07:02:19,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-26 07:02:19,837 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-26 07:02:19,838 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-26 07:02:19,839 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-26 07:02:19,839 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695712339839 2023-09-26 07:02:19,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,849 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-26 07:02:19,849 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:19,850 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-26 07:02:19,850 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-26 07:02:19,850 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,850 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,852 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:19,852 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:19,852 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:19,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:19,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:19,852 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:19,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:19,852 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:19,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:19,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:19,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:19,852 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:19,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,853 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:19,853 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 07:02:19,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-26 07:02:19,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-26 07:02:19,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-26 07:02:19,853 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-26 07:02:19,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,854 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-26 07:02:19,854 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-26 07:02:19,854 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,854 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,854 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-26 07:02:19,854 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-26 07:02:19,854 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,854 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:19,854 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-26 07:02:19,855 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:19,855 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-26 07:02:19,856 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-26 07:02:19,856 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-26 07:02:19,854 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:19,856 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39873,1695711667206' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-26 07:02:19,856 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-26 07:02:19,857 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-26 07:02:19,857 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-26 07:02:19,857 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42373,1695711667152' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-26 07:02:19,857 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32791,1695711667250' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-26 07:02:19,865 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,865 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:19,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:19,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:19,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:19,865 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,866 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,866 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:19,866 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:02:19,866 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:19,866 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,866 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:02:19,866 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,866 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:02:19,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:19,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:19,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:19,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:19,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:19,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39873,1695711667206' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-26 07:02:19,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@656fe33f[Count = 1] remaining members to acquire global barrier 2023-09-26 07:02:19,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:19,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:19,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:19,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:19,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:19,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:19,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:19,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:19,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:19,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32791,1695711667250' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-26 07:02:19,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@656fe33f[Count = 0] remaining members to acquire global barrier 2023-09-26 07:02:19,869 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-26 07:02:19,869 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,870 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,870 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,870 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-26 07:02:19,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-26 07:02:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-26 07:02:19,871 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:19,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42373,1695711667152' in zk 2023-09-26 07:02:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-26 07:02:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:02:19,871 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450. 2023-09-26 07:02:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:02:19,871 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450. started... 2023-09-26 07:02:19,871 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:19,871 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 07:02:19,873 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:02:19,873 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. 2023-09-26 07:02:19,873 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:02:19,873 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 143c0e4b33273307e7d01f9c2d825450: 2023-09-26 07:02:19,873 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. started... 2023-09-26 07:02:19,873 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 68728829bb43a43e00ff99e719792c51: 2023-09-26 07:02:19,873 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,873 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:02:19,873 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,873 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 07:02:19,873 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:02:19,873 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 07:02:19,878 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-26 07:02:19,878 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:19,878 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-26 07:02:19,883 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450. completed. 2023-09-26 07:02:19,883 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. completed. 2023-09-26 07:02:19,883 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. 2023-09-26 07:02:19,883 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450. 2023-09-26 07:02:19,884 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:02:19,884 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:02:19,884 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:19,884 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:02:19,884 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-26 07:02:19,884 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:02:19,884 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:19,884 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39873,1695711667206' in zk 2023-09-26 07:02:19,884 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-26 07:02:19,884 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,32791,1695711667250' in zk 2023-09-26 07:02:19,885 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-26 07:02:19,885 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-26 07:02:19,885 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:19,885 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:19,885 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-26 07:02:19,885 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:19,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:19,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:19,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:19,887 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:19,887 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-26 07:02:19,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:19,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:19,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:19,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:19,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:19,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:19,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,32791,1695711667250': 2023-09-26 07:02:19,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32791,1695711667250' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-26 07:02:19,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:19,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:19,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:19,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:19,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:19,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:19,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:19,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:19,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:19,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:19,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:19,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:19,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39873,1695711667206': 2023-09-26 07:02:19,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39873,1695711667206' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-26 07:02:19,895 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-26 07:02:19,895 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 07:02:19,895 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 07:02:19,895 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,895 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 07:02:19,897 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,897 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,897 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,897 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:19,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:19,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:19,897 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:19,897 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,898 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:19,898 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:19,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:19,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:19,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:19,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:19,898 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:19,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:19,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:19,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:19,899 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:19,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:19,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:19,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:19,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:19,901 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:19,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:19,901 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:19,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,901 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:19,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:19,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:19,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:19,904 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:19,904 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:19,905 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,904 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:19,905 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:19,905 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:19,904 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:19,907 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:19,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:19,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:19,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:19,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:19,905 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,905 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:19,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:19,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:19,905 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:19,908 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:19,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:19,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:19,908 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,908 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,908 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:19,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:19,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:19,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,908 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 07:02:19,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:19,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:19,908 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:19,909 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:19,909 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,909 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-26 07:02:19,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,936 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:02:19,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-26 07:02:19,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-26 07:02:19,937 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 07:02:19,939 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,940 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-26 07:02:19,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,940 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:19,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695711739834Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695711739921 (+87 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695711739921Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695711739921Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695711739924 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695711739934 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695711739940 (+6 ms) 2023-09-26 07:02:19,943 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-26 07:02:19,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 108 msec 2023-09-26 07:02:20,137 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:02:20,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-26 07:02:20,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 07:02:20,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39873] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 07:02:20,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32791] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 07:02:20,145 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,145 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. 2023-09-26 07:02:20,145 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 07:02:20,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-26 07:02:20,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695711740155 (current time:1695711740155). 2023-09-26 07:02:20,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 07:02:20,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x7d9e72db to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:02:20,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49d5bc58, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:02:20,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:02:20,168 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52284, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:02:20,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d9e72db to 127.0.0.1:50261 2023-09-26 07:02:20,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:02:20,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x661f2e10 to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:02:20,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@689980a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:02:20,176 DEBUG [hconnection-0xc4ad695-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:02:20,179 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52296, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:02:20,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:02:20,185 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:02:20,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x661f2e10 to 127.0.0.1:50261 2023-09-26 07:02:20,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:02:20,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-26 07:02:20,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 07:02:20,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-26 07:02:20,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-26 07:02:20,189 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-26 07:02:20,190 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695712340190 2023-09-26 07:02:20,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-26 07:02:20,190 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,191 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 07:02:20,191 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 07:02:20,191 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-26 07:02:20,192 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-26 07:02:20,193 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-09-26 07:02:20,194 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-26 07:02:20,195 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695712340195 2023-09-26 07:02:20,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,203 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-26 07:02:20,203 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:20,204 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-26 07:02:20,204 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-26 07:02:20,204 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,204 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,207 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:20,207 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:20,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:20,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:20,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:20,207 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:20,207 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:20,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:20,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:20,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:20,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,207 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:20,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,207 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,207 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:20,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,208 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:20,208 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 07:02:20,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-26 07:02:20,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-26 07:02:20,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,208 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-26 07:02:20,208 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-26 07:02:20,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-26 07:02:20,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,208 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,209 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-26 07:02:20,209 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,209 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-26 07:02:20,209 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-26 07:02:20,209 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:20,209 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:20,210 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,210 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-26 07:02:20,211 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-26 07:02:20,211 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:20,210 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-26 07:02:20,211 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-26 07:02:20,212 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-26 07:02:20,211 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-26 07:02:20,212 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32791,1695711667250' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-26 07:02:20,211 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-26 07:02:20,212 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39873,1695711667206' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-26 07:02:20,212 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42373,1695711667152' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-26 07:02:20,213 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,213 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,213 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:20,213 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:20,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:20,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:20,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:20,214 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:20,214 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,214 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:02:20,214 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,214 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:02:20,214 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:20,214 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:02:20,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:20,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:20,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:20,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:20,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32791,1695711667250' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-26 07:02:20,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7156f19c[Count = 1] remaining members to acquire global barrier 2023-09-26 07:02:20,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:20,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:20,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:20,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:20,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:20,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:20,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:20,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:20,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:20,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39873,1695711667206' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-26 07:02:20,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7156f19c[Count = 0] remaining members to acquire global barrier 2023-09-26 07:02:20,218 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-26 07:02:20,218 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,219 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,219 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,219 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,219 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:20,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,219 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-26 07:02:20,219 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-26 07:02:20,219 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-26 07:02:20,219 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:20,219 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 07:02:20,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,219 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:02:20,219 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. 2023-09-26 07:02:20,219 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42373,1695711667152' in zk 2023-09-26 07:02:20,220 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. started... 2023-09-26 07:02:20,220 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:02:20,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,220 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-26 07:02:20,220 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 68728829bb43a43e00ff99e719792c51 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-26 07:02:20,220 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:02:20,220 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:02:20,220 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450. 2023-09-26 07:02:20,220 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450. started... 2023-09-26 07:02:20,220 INFO [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 143c0e4b33273307e7d01f9c2d825450 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-26 07:02:20,222 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-26 07:02:20,222 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:20,222 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-26 07:02:20,242 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230926b5c355fd28e8446d92dad4531850ceb6 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230926b5c355fd28e8446d92dad4531850ceb6 2023-09-26 07:02:20,242 INFO [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230926fd9b04fcc13d46dd9c6166bad5d50981 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230926fd9b04fcc13d46dd9c6166bad5d50981 2023-09-26 07:02:20,252 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/68728829bb43a43e00ff99e719792c51/.tmp/cf/566de8090c364f4181b892a4772b5f86 2023-09-26 07:02:20,257 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/68728829bb43a43e00ff99e719792c51/.tmp/cf/566de8090c364f4181b892a4772b5f86 as hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/68728829bb43a43e00ff99e719792c51/cf/566de8090c364f4181b892a4772b5f86 2023-09-26 07:02:20,259 INFO [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/143c0e4b33273307e7d01f9c2d825450/.tmp/cf/b607a50b0f0c4f1896f6ea2ad114b968 2023-09-26 07:02:20,262 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/68728829bb43a43e00ff99e719792c51/cf/566de8090c364f4181b892a4772b5f86, entries=5, sequenceid=6, filesize=5.8 K 2023-09-26 07:02:20,263 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 68728829bb43a43e00ff99e719792c51 in 43ms, sequenceid=6, compaction requested=false 2023-09-26 07:02:20,263 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-26 07:02:20,263 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 68728829bb43a43e00ff99e719792c51: 2023-09-26 07:02:20,264 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,264 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:02:20,264 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/68728829bb43a43e00ff99e719792c51/cf/566de8090c364f4181b892a4772b5f86] hfiles 2023-09-26 07:02:20,264 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/68728829bb43a43e00ff99e719792c51/cf/566de8090c364f4181b892a4772b5f86 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,264 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/143c0e4b33273307e7d01f9c2d825450/.tmp/cf/b607a50b0f0c4f1896f6ea2ad114b968 as hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/143c0e4b33273307e7d01f9c2d825450/cf/b607a50b0f0c4f1896f6ea2ad114b968 2023-09-26 07:02:20,271 INFO [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/143c0e4b33273307e7d01f9c2d825450/cf/b607a50b0f0c4f1896f6ea2ad114b968, entries=45, sequenceid=6, filesize=13.2 K 2023-09-26 07:02:20,272 INFO [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 143c0e4b33273307e7d01f9c2d825450 in 52ms, sequenceid=6, compaction requested=false 2023-09-26 07:02:20,274 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 143c0e4b33273307e7d01f9c2d825450: 2023-09-26 07:02:20,275 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,275 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:02:20,275 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/143c0e4b33273307e7d01f9c2d825450/cf/b607a50b0f0c4f1896f6ea2ad114b968] hfiles 2023-09-26 07:02:20,275 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/143c0e4b33273307e7d01f9c2d825450/cf/b607a50b0f0c4f1896f6ea2ad114b968 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,277 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. completed. 2023-09-26 07:02:20,277 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. 2023-09-26 07:02:20,277 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:02:20,277 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:02:20,277 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:20,277 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-26 07:02:20,277 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39873,1695711667206' in zk 2023-09-26 07:02:20,279 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:20,279 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-26 07:02:20,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:20,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:20,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:20,279 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:20,279 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-26 07:02:20,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:20,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:20,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:20,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:20,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:20,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:20,283 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450. completed. 2023-09-26 07:02:20,283 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450. 2023-09-26 07:02:20,283 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:02:20,284 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:02:20,284 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:20,284 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-26 07:02:20,284 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,32791,1695711667250' in zk 2023-09-26 07:02:20,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:20,285 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:20,285 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-26 07:02:20,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:20,285 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:20,285 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-26 07:02:20,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39873,1695711667206': 2023-09-26 07:02:20,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39873,1695711667206' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-26 07:02:20,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:20,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:20,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:20,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:20,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:20,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:20,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:20,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:20,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:20,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:20,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:20,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:20,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,32791,1695711667250': 2023-09-26 07:02:20,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32791,1695711667250' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-26 07:02:20,291 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-26 07:02:20,291 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 07:02:20,291 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 07:02:20,291 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,291 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 07:02:20,291 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:02:20,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-26 07:02:20,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-26 07:02:20,292 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 07:02:20,297 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,297 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,297 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:20,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:20,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:20,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,297 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,297 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,297 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:20,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,298 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:20,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:20,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,297 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:20,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:20,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:20,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:20,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:20,298 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:20,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:20,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:20,298 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:20,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:20,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:20,300 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:20,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:20,300 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:20,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,301 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:20,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:20,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:20,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:20,303 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:20,303 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:20,304 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:20,304 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:20,304 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:20,304 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:20,304 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:20,304 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:20,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:20,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:20,304 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:20,304 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,304 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:20,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:20,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:20,306 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,306 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:20,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,305 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:20,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 07:02:20,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:20,306 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:20,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:20,306 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:20,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:20,306 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:20,307 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:20,307 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,307 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:20,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:20,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230926fd9b04fcc13d46dd9c6166bad5d50981, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230926b5c355fd28e8446d92dad4531850ceb6] mob files 2023-09-26 07:02:20,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230926fd9b04fcc13d46dd9c6166bad5d50981 2023-09-26 07:02:20,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230926b5c355fd28e8446d92dad4531850ceb6 2023-09-26 07:02:20,315 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,315 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,344 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,345 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-26 07:02:20,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,345 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:20,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695711740190Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695711740315 (+125 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695711740315Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695711740315Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695711740321 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695711740337 (+16 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695711740345 (+8 ms) 2023-09-26 07:02:20,348 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-26 07:02:20,349 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 157 msec 2023-09-26 07:02:20,493 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:02:20,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-26 07:02:20,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 07:02:20,524 DEBUG [Listener at jenkins-hbase4.apache.org/41375] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-26 07:02:20,530 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-26 07:02:20,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32791] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-26 07:02:20,532 DEBUG [Listener at jenkins-hbase4.apache.org/41375] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-26 07:02:20,534 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-26 07:02:20,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39873] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-26 07:02:20,534 DEBUG [Listener at jenkins-hbase4.apache.org/41375] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-26 07:02:20,536 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45692, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-26 07:02:20,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42373] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-26 07:02:20,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-26 07:02:20,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:20,541 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-26 07:02:20,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-26 07:02:20,542 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-26 07:02:20,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-26 07:02:20,544 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c0d7c514e054d33786fec139a242872 2023-09-26 07:02:20,544 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/68356915f49ce3dcd53ecca9813c1dfc 2023-09-26 07:02:20,544 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c0d7c514e054d33786fec139a242872 empty. 2023-09-26 07:02:20,544 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/68356915f49ce3dcd53ecca9813c1dfc empty. 2023-09-26 07:02:20,545 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c0d7c514e054d33786fec139a242872 2023-09-26 07:02:20,545 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/68356915f49ce3dcd53ecca9813c1dfc 2023-09-26 07:02:20,545 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-26 07:02:20,554 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-26 07:02:20,555 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8c0d7c514e054d33786fec139a242872, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp 2023-09-26 07:02:20,556 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 68356915f49ce3dcd53ecca9813c1dfc, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp 2023-09-26 07:02:20,564 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:02:20,564 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 8c0d7c514e054d33786fec139a242872, disabling compactions & flushes 2023-09-26 07:02:20,564 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872. 2023-09-26 07:02:20,564 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872. 2023-09-26 07:02:20,564 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872. after waiting 0 ms 2023-09-26 07:02:20,564 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872. 2023-09-26 07:02:20,564 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872. 2023-09-26 07:02:20,564 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 8c0d7c514e054d33786fec139a242872: 2023-09-26 07:02:20,565 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:02:20,565 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 68356915f49ce3dcd53ecca9813c1dfc, disabling compactions & flushes 2023-09-26 07:02:20,565 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc. 2023-09-26 07:02:20,565 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc. 2023-09-26 07:02:20,565 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc. after waiting 0 ms 2023-09-26 07:02:20,565 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc. 2023-09-26 07:02:20,565 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc. 2023-09-26 07:02:20,565 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 68356915f49ce3dcd53ecca9813c1dfc: 2023-09-26 07:02:20,567 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-26 07:02:20,568 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695711740567"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711740567"}]},"ts":"1695711740567"} 2023-09-26 07:02:20,568 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695711740567"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711740567"}]},"ts":"1695711740567"} 2023-09-26 07:02:20,570 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-26 07:02:20,570 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-26 07:02:20,570 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711740570"}]},"ts":"1695711740570"} 2023-09-26 07:02:20,571 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-26 07:02:20,574 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-26 07:02:20,575 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-26 07:02:20,575 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-26 07:02:20,575 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-26 07:02:20,575 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-26 07:02:20,576 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8c0d7c514e054d33786fec139a242872, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=68356915f49ce3dcd53ecca9813c1dfc, ASSIGN}] 2023-09-26 07:02:20,578 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8c0d7c514e054d33786fec139a242872, ASSIGN 2023-09-26 07:02:20,578 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=68356915f49ce3dcd53ecca9813c1dfc, ASSIGN 2023-09-26 07:02:20,579 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8c0d7c514e054d33786fec139a242872, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42373,1695711667152; forceNewPlan=false, retain=false 2023-09-26 07:02:20,579 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=68356915f49ce3dcd53ecca9813c1dfc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32791,1695711667250; forceNewPlan=false, retain=false 2023-09-26 07:02:20,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-26 07:02:20,729 INFO [jenkins-hbase4:38147] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-26 07:02:20,732 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=68356915f49ce3dcd53ecca9813c1dfc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:20,732 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8c0d7c514e054d33786fec139a242872, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:20,732 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695711740732"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711740732"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711740732"}]},"ts":"1695711740732"} 2023-09-26 07:02:20,732 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695711740732"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711740732"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711740732"}]},"ts":"1695711740732"} 2023-09-26 07:02:20,734 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 68356915f49ce3dcd53ecca9813c1dfc, server=jenkins-hbase4.apache.org,32791,1695711667250}] 2023-09-26 07:02:20,735 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 8c0d7c514e054d33786fec139a242872, server=jenkins-hbase4.apache.org,42373,1695711667152}] 2023-09-26 07:02:20,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-26 07:02:20,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc. 2023-09-26 07:02:20,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 68356915f49ce3dcd53ecca9813c1dfc, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc.', STARTKEY => '2', ENDKEY => ''} 2023-09-26 07:02:20,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872. 2023-09-26 07:02:20,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8c0d7c514e054d33786fec139a242872, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872.', STARTKEY => '', ENDKEY => '2'} 2023-09-26 07:02:20,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc. service=AccessControlService 2023-09-26 07:02:20,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872. service=AccessControlService 2023-09-26 07:02:20,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 07:02:20,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 07:02:20,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 68356915f49ce3dcd53ecca9813c1dfc 2023-09-26 07:02:20,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 8c0d7c514e054d33786fec139a242872 2023-09-26 07:02:20,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:02:20,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:02:20,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 68356915f49ce3dcd53ecca9813c1dfc 2023-09-26 07:02:20,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8c0d7c514e054d33786fec139a242872 2023-09-26 07:02:20,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 68356915f49ce3dcd53ecca9813c1dfc 2023-09-26 07:02:20,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8c0d7c514e054d33786fec139a242872 2023-09-26 07:02:20,892 INFO [StoreOpener-68356915f49ce3dcd53ecca9813c1dfc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 68356915f49ce3dcd53ecca9813c1dfc 2023-09-26 07:02:20,892 INFO [StoreOpener-8c0d7c514e054d33786fec139a242872-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8c0d7c514e054d33786fec139a242872 2023-09-26 07:02:20,893 DEBUG [StoreOpener-68356915f49ce3dcd53ecca9813c1dfc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/68356915f49ce3dcd53ecca9813c1dfc/cf 2023-09-26 07:02:20,893 DEBUG [StoreOpener-68356915f49ce3dcd53ecca9813c1dfc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/68356915f49ce3dcd53ecca9813c1dfc/cf 2023-09-26 07:02:20,893 DEBUG [StoreOpener-8c0d7c514e054d33786fec139a242872-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c0d7c514e054d33786fec139a242872/cf 2023-09-26 07:02:20,893 DEBUG [StoreOpener-8c0d7c514e054d33786fec139a242872-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c0d7c514e054d33786fec139a242872/cf 2023-09-26 07:02:20,893 INFO [StoreOpener-68356915f49ce3dcd53ecca9813c1dfc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68356915f49ce3dcd53ecca9813c1dfc columnFamilyName cf 2023-09-26 07:02:20,894 INFO [StoreOpener-8c0d7c514e054d33786fec139a242872-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c0d7c514e054d33786fec139a242872 columnFamilyName cf 2023-09-26 07:02:20,894 INFO [StoreOpener-68356915f49ce3dcd53ecca9813c1dfc-1] regionserver.HStore(310): Store=68356915f49ce3dcd53ecca9813c1dfc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:02:20,894 INFO [StoreOpener-8c0d7c514e054d33786fec139a242872-1] regionserver.HStore(310): Store=8c0d7c514e054d33786fec139a242872/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:02:20,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/68356915f49ce3dcd53ecca9813c1dfc 2023-09-26 07:02:20,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c0d7c514e054d33786fec139a242872 2023-09-26 07:02:20,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/68356915f49ce3dcd53ecca9813c1dfc 2023-09-26 07:02:20,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c0d7c514e054d33786fec139a242872 2023-09-26 07:02:20,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8c0d7c514e054d33786fec139a242872 2023-09-26 07:02:20,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 68356915f49ce3dcd53ecca9813c1dfc 2023-09-26 07:02:20,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/68356915f49ce3dcd53ecca9813c1dfc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 07:02:20,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c0d7c514e054d33786fec139a242872/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 07:02:20,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 68356915f49ce3dcd53ecca9813c1dfc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74188421, jitterRate=0.10549362003803253}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 07:02:20,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8c0d7c514e054d33786fec139a242872; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75031230, jitterRate=0.11805245280265808}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 07:02:20,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 68356915f49ce3dcd53ecca9813c1dfc: 2023-09-26 07:02:20,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8c0d7c514e054d33786fec139a242872: 2023-09-26 07:02:20,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc., pid=69, masterSystemTime=1695711740885 2023-09-26 07:02:20,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872., pid=70, masterSystemTime=1695711740887 2023-09-26 07:02:20,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc. 2023-09-26 07:02:20,902 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc. 2023-09-26 07:02:20,903 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=68356915f49ce3dcd53ecca9813c1dfc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:20,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872. 2023-09-26 07:02:20,903 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695711740903"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695711740903"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695711740903"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695711740903"}]},"ts":"1695711740903"} 2023-09-26 07:02:20,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872. 2023-09-26 07:02:20,904 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8c0d7c514e054d33786fec139a242872, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:20,904 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695711740903"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695711740903"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695711740903"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695711740903"}]},"ts":"1695711740903"} 2023-09-26 07:02:20,906 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-09-26 07:02:20,906 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 68356915f49ce3dcd53ecca9813c1dfc, server=jenkins-hbase4.apache.org,32791,1695711667250 in 170 msec 2023-09-26 07:02:20,907 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-09-26 07:02:20,907 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 8c0d7c514e054d33786fec139a242872, server=jenkins-hbase4.apache.org,42373,1695711667152 in 170 msec 2023-09-26 07:02:20,907 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=68356915f49ce3dcd53ecca9813c1dfc, ASSIGN in 331 msec 2023-09-26 07:02:20,909 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-09-26 07:02:20,909 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8c0d7c514e054d33786fec139a242872, ASSIGN in 332 msec 2023-09-26 07:02:20,909 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-26 07:02:20,909 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711740909"}]},"ts":"1695711740909"} 2023-09-26 07:02:20,910 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-26 07:02:20,912 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-26 07:02:20,913 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-26 07:02:20,914 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39873] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-26 07:02:20,916 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:20,916 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:20,916 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:20,916 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:20,918 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:20,918 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:20,918 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:20,918 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:20,918 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:20,918 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:20,918 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:20,918 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:20,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 379 msec 2023-09-26 07:02:21,064 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-26 07:02:21,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-26 07:02:21,146 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-26 07:02:21,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 8c0d7c514e054d33786fec139a242872, 68356915f49ce3dcd53ecca9813c1dfc 2023-09-26 07:02:21,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[8c0d7c514e054d33786fec139a242872, 68356915f49ce3dcd53ecca9813c1dfc], force=true 2023-09-26 07:02:21,177 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[8c0d7c514e054d33786fec139a242872, 68356915f49ce3dcd53ecca9813c1dfc], force=true 2023-09-26 07:02:21,177 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[8c0d7c514e054d33786fec139a242872, 68356915f49ce3dcd53ecca9813c1dfc], force=true 2023-09-26 07:02:21,178 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[8c0d7c514e054d33786fec139a242872, 68356915f49ce3dcd53ecca9813c1dfc], force=true 2023-09-26 07:02:21,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-26 07:02:21,200 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8c0d7c514e054d33786fec139a242872, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=68356915f49ce3dcd53ecca9813c1dfc, UNASSIGN}] 2023-09-26 07:02:21,202 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8c0d7c514e054d33786fec139a242872, UNASSIGN 2023-09-26 07:02:21,202 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=68356915f49ce3dcd53ecca9813c1dfc, UNASSIGN 2023-09-26 07:02:21,203 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=8c0d7c514e054d33786fec139a242872, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:21,203 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=68356915f49ce3dcd53ecca9813c1dfc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:21,203 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695711741203"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711741203"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711741203"}]},"ts":"1695711741203"} 2023-09-26 07:02:21,203 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695711741203"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711741203"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711741203"}]},"ts":"1695711741203"} 2023-09-26 07:02:21,204 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 8c0d7c514e054d33786fec139a242872, server=jenkins-hbase4.apache.org,42373,1695711667152}] 2023-09-26 07:02:21,205 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 68356915f49ce3dcd53ecca9813c1dfc, server=jenkins-hbase4.apache.org,32791,1695711667250}] 2023-09-26 07:02:21,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-26 07:02:21,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 68356915f49ce3dcd53ecca9813c1dfc 2023-09-26 07:02:21,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8c0d7c514e054d33786fec139a242872 2023-09-26 07:02:21,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 68356915f49ce3dcd53ecca9813c1dfc, disabling compactions & flushes 2023-09-26 07:02:21,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8c0d7c514e054d33786fec139a242872, disabling compactions & flushes 2023-09-26 07:02:21,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc. 2023-09-26 07:02:21,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872. 2023-09-26 07:02:21,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc. 2023-09-26 07:02:21,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872. 2023-09-26 07:02:21,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc. after waiting 0 ms 2023-09-26 07:02:21,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc. 2023-09-26 07:02:21,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872. after waiting 0 ms 2023-09-26 07:02:21,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872. 2023-09-26 07:02:21,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 68356915f49ce3dcd53ecca9813c1dfc 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-26 07:02:21,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 8c0d7c514e054d33786fec139a242872 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-26 07:02:21,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c0d7c514e054d33786fec139a242872/.tmp/cf/3be93a05fe2642af8a01bd64a568c167 2023-09-26 07:02:21,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/68356915f49ce3dcd53ecca9813c1dfc/.tmp/cf/923f21ac855e427db489925be5979b01 2023-09-26 07:02:21,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/68356915f49ce3dcd53ecca9813c1dfc/.tmp/cf/923f21ac855e427db489925be5979b01 as hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/68356915f49ce3dcd53ecca9813c1dfc/cf/923f21ac855e427db489925be5979b01 2023-09-26 07:02:21,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c0d7c514e054d33786fec139a242872/.tmp/cf/3be93a05fe2642af8a01bd64a568c167 as hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c0d7c514e054d33786fec139a242872/cf/3be93a05fe2642af8a01bd64a568c167 2023-09-26 07:02:21,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/68356915f49ce3dcd53ecca9813c1dfc/cf/923f21ac855e427db489925be5979b01, entries=1, sequenceid=5, filesize=4.7 K 2023-09-26 07:02:21,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c0d7c514e054d33786fec139a242872/cf/3be93a05fe2642af8a01bd64a568c167, entries=1, sequenceid=5, filesize=4.7 K 2023-09-26 07:02:21,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 8c0d7c514e054d33786fec139a242872 in 23ms, sequenceid=5, compaction requested=false 2023-09-26 07:02:21,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 68356915f49ce3dcd53ecca9813c1dfc in 23ms, sequenceid=5, compaction requested=false 2023-09-26 07:02:21,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/68356915f49ce3dcd53ecca9813c1dfc/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-26 07:02:21,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c0d7c514e054d33786fec139a242872/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-26 07:02:21,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:02:21,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:02:21,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc. 2023-09-26 07:02:21,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872. 2023-09-26 07:02:21,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 68356915f49ce3dcd53ecca9813c1dfc: 2023-09-26 07:02:21,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8c0d7c514e054d33786fec139a242872: 2023-09-26 07:02:21,394 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8c0d7c514e054d33786fec139a242872 2023-09-26 07:02:21,394 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=8c0d7c514e054d33786fec139a242872, regionState=CLOSED 2023-09-26 07:02:21,394 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695711741394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711741394"}]},"ts":"1695711741394"} 2023-09-26 07:02:21,394 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 68356915f49ce3dcd53ecca9813c1dfc 2023-09-26 07:02:21,395 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=68356915f49ce3dcd53ecca9813c1dfc, regionState=CLOSED 2023-09-26 07:02:21,395 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695711741395"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711741395"}]},"ts":"1695711741395"} 2023-09-26 07:02:21,399 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-26 07:02:21,399 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 8c0d7c514e054d33786fec139a242872, server=jenkins-hbase4.apache.org,42373,1695711667152 in 193 msec 2023-09-26 07:02:21,399 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-26 07:02:21,399 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 68356915f49ce3dcd53ecca9813c1dfc, server=jenkins-hbase4.apache.org,32791,1695711667250 in 193 msec 2023-09-26 07:02:21,400 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8c0d7c514e054d33786fec139a242872, UNASSIGN in 202 msec 2023-09-26 07:02:21,401 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-09-26 07:02:21,401 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=68356915f49ce3dcd53ecca9813c1dfc, UNASSIGN in 199 msec 2023-09-26 07:02:21,443 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30a55dff90caeeab6740dec2e0d80747/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-26 07:02:21,445 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740538.8c0d7c514e054d33786fec139a242872.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-26 07:02:21,446 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695711740538.68356915f49ce3dcd53ecca9813c1dfc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-26 07:02:21,446 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-26 07:02:21,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-26 07:02:21,496 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=30a55dff90caeeab6740dec2e0d80747, ASSIGN}] 2023-09-26 07:02:21,497 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=30a55dff90caeeab6740dec2e0d80747, ASSIGN 2023-09-26 07:02:21,497 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=30a55dff90caeeab6740dec2e0d80747, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,42373,1695711667152; forceNewPlan=false, retain=false 2023-09-26 07:02:21,648 INFO [jenkins-hbase4:38147] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-26 07:02:21,650 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=30a55dff90caeeab6740dec2e0d80747, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:21,650 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695711741650"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711741650"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711741650"}]},"ts":"1695711741650"} 2023-09-26 07:02:21,652 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 30a55dff90caeeab6740dec2e0d80747, server=jenkins-hbase4.apache.org,42373,1695711667152}] 2023-09-26 07:02:21,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-26 07:02:21,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747. 2023-09-26 07:02:21,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 30a55dff90caeeab6740dec2e0d80747, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747.', STARTKEY => '', ENDKEY => ''} 2023-09-26 07:02:21,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747. service=AccessControlService 2023-09-26 07:02:21,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 07:02:21,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 30a55dff90caeeab6740dec2e0d80747 2023-09-26 07:02:21,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:02:21,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 30a55dff90caeeab6740dec2e0d80747 2023-09-26 07:02:21,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 30a55dff90caeeab6740dec2e0d80747 2023-09-26 07:02:21,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30a55dff90caeeab6740dec2e0d80747/.regioninfo 2023-09-26 07:02:21,816 INFO [StoreOpener-30a55dff90caeeab6740dec2e0d80747-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 30a55dff90caeeab6740dec2e0d80747 2023-09-26 07:02:21,817 DEBUG [StoreOpener-30a55dff90caeeab6740dec2e0d80747-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30a55dff90caeeab6740dec2e0d80747/cf 2023-09-26 07:02:21,817 DEBUG [StoreOpener-30a55dff90caeeab6740dec2e0d80747-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30a55dff90caeeab6740dec2e0d80747/cf 2023-09-26 07:02:21,817 INFO [StoreOpener-30a55dff90caeeab6740dec2e0d80747-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30a55dff90caeeab6740dec2e0d80747 columnFamilyName cf 2023-09-26 07:02:21,844 DEBUG [StoreOpener-30a55dff90caeeab6740dec2e0d80747-1] regionserver.HStore(539): loaded hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30a55dff90caeeab6740dec2e0d80747/cf/3be93a05fe2642af8a01bd64a568c167.8c0d7c514e054d33786fec139a242872->hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c0d7c514e054d33786fec139a242872/cf/3be93a05fe2642af8a01bd64a568c167-top 2023-09-26 07:02:21,850 DEBUG [StoreOpener-30a55dff90caeeab6740dec2e0d80747-1] regionserver.HStore(539): loaded hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30a55dff90caeeab6740dec2e0d80747/cf/923f21ac855e427db489925be5979b01.68356915f49ce3dcd53ecca9813c1dfc->hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/68356915f49ce3dcd53ecca9813c1dfc/cf/923f21ac855e427db489925be5979b01-top 2023-09-26 07:02:21,851 INFO [StoreOpener-30a55dff90caeeab6740dec2e0d80747-1] regionserver.HStore(310): Store=30a55dff90caeeab6740dec2e0d80747/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:02:21,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30a55dff90caeeab6740dec2e0d80747 2023-09-26 07:02:21,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30a55dff90caeeab6740dec2e0d80747 2023-09-26 07:02:21,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 30a55dff90caeeab6740dec2e0d80747 2023-09-26 07:02:21,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 30a55dff90caeeab6740dec2e0d80747; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71660877, jitterRate=0.06783027946949005}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 07:02:21,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 30a55dff90caeeab6740dec2e0d80747: 2023-09-26 07:02:21,857 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747., pid=77, masterSystemTime=1695711741803 2023-09-26 07:02:21,858 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747.,because compaction is disabled. 2023-09-26 07:02:21,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747. 2023-09-26 07:02:21,859 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747. 2023-09-26 07:02:21,859 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=30a55dff90caeeab6740dec2e0d80747, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:21,860 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695711741859"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695711741859"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695711741859"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695711741859"}]},"ts":"1695711741859"} 2023-09-26 07:02:21,863 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-26 07:02:21,863 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 30a55dff90caeeab6740dec2e0d80747, server=jenkins-hbase4.apache.org,42373,1695711667152 in 209 msec 2023-09-26 07:02:21,865 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-26 07:02:21,865 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=30a55dff90caeeab6740dec2e0d80747, ASSIGN in 367 msec 2023-09-26 07:02:21,866 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[8c0d7c514e054d33786fec139a242872, 68356915f49ce3dcd53ecca9813c1dfc], force=true in 695 msec 2023-09-26 07:02:22,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-26 07:02:22,285 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-26 07:02:22,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-26 07:02:22,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695711742286 (current time:1695711742286). 2023-09-26 07:02:22,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 07:02:22,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x113bdad0 to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:02:22,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31e86d9d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:02:22,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:02:22,299 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52306, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:02:22,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x113bdad0 to 127.0.0.1:50261 2023-09-26 07:02:22,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:02:22,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x3c5440d0 to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:02:22,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73f6f0d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:02:22,309 DEBUG [hconnection-0x180ffb6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:02:22,312 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52310, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:02:22,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:02:22,318 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:02:22,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c5440d0 to 127.0.0.1:50261 2023-09-26 07:02:22,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:02:22,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-26 07:02:22,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 07:02:22,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-26 07:02:22,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-26 07:02:22,323 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-26 07:02:22,324 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695712342324 2023-09-26 07:02:22,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-26 07:02:22,324 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,327 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 07:02:22,327 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 07:02:22,328 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-26 07:02:22,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-26 07:02:22,329 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-26 07:02:22,330 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-26 07:02:22,331 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695712342331 2023-09-26 07:02:22,339 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,340 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-26 07:02:22,340 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:22,341 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-26 07:02:22,341 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-26 07:02:22,341 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,341 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,344 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:22,344 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:22,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:22,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:22,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:22,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:22,344 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:22,344 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:22,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:22,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:22,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,344 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:22,344 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 07:02:22,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-26 07:02:22,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-26 07:02:22,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,345 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-26 07:02:22,345 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-26 07:02:22,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-26 07:02:22,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,345 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,345 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,345 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-26 07:02:22,346 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-26 07:02:22,346 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:22,345 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-26 07:02:22,347 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-26 07:02:22,347 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-26 07:02:22,346 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:22,347 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42373,1695711667152' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-26 07:02:22,347 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,348 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-26 07:02:22,348 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-26 07:02:22,348 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-26 07:02:22,348 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32791,1695711667250' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-26 07:02:22,348 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:22,349 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-26 07:02:22,349 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-26 07:02:22,349 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39873,1695711667206' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-26 07:02:22,351 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:22,351 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:22,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:22,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:22,353 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,354 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:22,354 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,354 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:02:22,354 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,354 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:02:22,354 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,354 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:02:22,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:22,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:22,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:22,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:22,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:22,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42373,1695711667152' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-26 07:02:22,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20da139[Count = 0] remaining members to acquire global barrier 2023-09-26 07:02:22,356 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-26 07:02:22,356 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,362 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,362 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,362 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,362 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:22,362 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 07:02:22,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,363 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-26 07:02:22,363 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-26 07:02:22,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,363 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-26 07:02:22,363 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-26 07:02:22,363 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-26 07:02:22,363 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,32791,1695711667250' in zk 2023-09-26 07:02:22,363 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39873,1695711667206' in zk 2023-09-26 07:02:22,363 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747. 2023-09-26 07:02:22,363 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:02:22,363 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747. started... 2023-09-26 07:02:22,363 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:02:22,364 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 30a55dff90caeeab6740dec2e0d80747: 2023-09-26 07:02:22,364 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,364 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:02:22,365 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30a55dff90caeeab6740dec2e0d80747/cf/3be93a05fe2642af8a01bd64a568c167.8c0d7c514e054d33786fec139a242872->hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c0d7c514e054d33786fec139a242872/cf/3be93a05fe2642af8a01bd64a568c167-top, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30a55dff90caeeab6740dec2e0d80747/cf/923f21ac855e427db489925be5979b01.68356915f49ce3dcd53ecca9813c1dfc->hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/68356915f49ce3dcd53ecca9813c1dfc/cf/923f21ac855e427db489925be5979b01-top] hfiles 2023-09-26 07:02:22,365 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30a55dff90caeeab6740dec2e0d80747/cf/3be93a05fe2642af8a01bd64a568c167.8c0d7c514e054d33786fec139a242872 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,365 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30a55dff90caeeab6740dec2e0d80747/cf/923f21ac855e427db489925be5979b01.68356915f49ce3dcd53ecca9813c1dfc for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,371 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-26 07:02:22,371 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-26 07:02:22,371 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:22,371 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:22,372 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-26 07:02:22,373 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-26 07:02:22,377 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747. completed. 2023-09-26 07:02:22,377 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747. 2023-09-26 07:02:22,377 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:02:22,377 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:02:22,377 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:22,377 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-26 07:02:22,377 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42373,1695711667152' in zk 2023-09-26 07:02:22,384 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-26 07:02:22,384 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:22,384 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:22,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:22,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:22,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:22,384 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-26 07:02:22,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:22,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:22,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:22,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:22,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:22,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:22,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:22,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:22,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:22,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,42373,1695711667152': 2023-09-26 07:02:22,387 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42373,1695711667152' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-26 07:02:22,387 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-26 07:02:22,387 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 07:02:22,387 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 07:02:22,387 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,387 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 07:02:22,389 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,389 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,389 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:22,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,389 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:22,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,389 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,389 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:22,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:22,389 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:22,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,389 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:22,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:22,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:22,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:22,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:22,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:22,390 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:22,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:22,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:22,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,390 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:22,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:22,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:22,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:22,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:22,392 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:22,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:22,392 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:22,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,392 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:22,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:22,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:22,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:22,395 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:22,395 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,395 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:22,395 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:22,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:22,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:22,395 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:22,395 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:22,395 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,395 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:22,396 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,395 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:22,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:22,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:22,395 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:22,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:22,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:22,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:22,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:22,396 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:22,396 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:22,396 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:22,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:22,396 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:22,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:22,397 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:22,397 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,397 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:22,397 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:22,397 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,397 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,419 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,419 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-26 07:02:22,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,420 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695711742324Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695711742396 (+72 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695711742396Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695711742399 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695711742411 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695711742419 (+8 ms) 2023-09-26 07:02:22,423 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-26 07:02:22,424 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 96 msec 2023-09-26 07:02:22,428 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:02:22,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-26 07:02:22,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 07:02:22,429 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711742429 2023-09-26 07:02:22,429 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36301, tgtDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711742429, rawTgtDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711742429, srcFsUri=hdfs://localhost:36301, srcDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1 2023-09-26 07:02:22,451 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36301, inputRoot=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1 2023-09-26 07:02:22,451 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_386130723_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711742429, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711742429/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,451 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36301, inputRoot=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1, snapshotDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-26 07:02:22,459 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711742429/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:22,475 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:22,475 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:22,475 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:22,476 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:23,346 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/hadoop-2133572749128431176.jar 2023-09-26 07:02:23,346 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:23,347 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:23,412 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/hadoop-2994988830350822983.jar 2023-09-26 07:02:23,413 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:23,413 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:23,414 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:23,414 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:23,414 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:23,415 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:23,415 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-26 07:02:23,416 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-26 07:02:23,416 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-26 07:02:23,416 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-26 07:02:23,417 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-26 07:02:23,417 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-26 07:02:23,418 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-26 07:02:23,418 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-26 07:02:23,418 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-26 07:02:23,419 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-26 07:02:23,419 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:02:23,420 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:02:23,420 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 07:02:23,420 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:02:23,421 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:02:23,421 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 07:02:23,422 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 07:02:23,709 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0004_000001 (auth:SIMPLE) 2023-09-26 07:02:23,791 WARN [Listener at jenkins-hbase4.apache.org/41375] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-26 07:02:23,794 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-26 07:02:23,796 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-26 07:02:23,854 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 07:02:23,854 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 07:02:24,445 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-26 07:02:24,583 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0005_000001 (auth:SIMPLE) 2023-09-26 07:02:28,339 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0005_000001 (auth:SIMPLE) 2023-09-26 07:02:30,557 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0005_000001 (auth:SIMPLE) 2023-09-26 07:02:32,965 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0005_000001 (auth:SIMPLE) 2023-09-26 07:02:34,957 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-26 07:02:34,960 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-26 07:02:34,969 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:34,969 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-26 07:02:34,969 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-26 07:02:34,970 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2080754119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:34,970 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-26 07:02:34,970 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-26 07:02:34,970 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2080754119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711742429/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711742429/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:34,971 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711742429/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-26 07:02:34,971 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711742429/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-26 07:02:34,977 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:34,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:34,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:34,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-26 07:02:34,982 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711754981"}]},"ts":"1695711754981"} 2023-09-26 07:02:34,983 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-26 07:02:34,985 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-26 07:02:34,985 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=30a55dff90caeeab6740dec2e0d80747, UNASSIGN}] 2023-09-26 07:02:34,987 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=30a55dff90caeeab6740dec2e0d80747, UNASSIGN 2023-09-26 07:02:34,988 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=30a55dff90caeeab6740dec2e0d80747, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:34,988 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695711754988"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711754988"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711754988"}]},"ts":"1695711754988"} 2023-09-26 07:02:34,989 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 30a55dff90caeeab6740dec2e0d80747, server=jenkins-hbase4.apache.org,42373,1695711667152}] 2023-09-26 07:02:35,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-26 07:02:35,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 30a55dff90caeeab6740dec2e0d80747 2023-09-26 07:02:35,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 30a55dff90caeeab6740dec2e0d80747, disabling compactions & flushes 2023-09-26 07:02:35,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747. 2023-09-26 07:02:35,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747. 2023-09-26 07:02:35,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747. after waiting 0 ms 2023-09-26 07:02:35,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747. 2023-09-26 07:02:35,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30a55dff90caeeab6740dec2e0d80747/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-26 07:02:35,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:02:35,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747. 2023-09-26 07:02:35,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 30a55dff90caeeab6740dec2e0d80747: 2023-09-26 07:02:35,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 30a55dff90caeeab6740dec2e0d80747 2023-09-26 07:02:35,155 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=30a55dff90caeeab6740dec2e0d80747, regionState=CLOSED 2023-09-26 07:02:35,156 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695711755155"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711755155"}]},"ts":"1695711755155"} 2023-09-26 07:02:35,158 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-26 07:02:35,158 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 30a55dff90caeeab6740dec2e0d80747, server=jenkins-hbase4.apache.org,42373,1695711667152 in 168 msec 2023-09-26 07:02:35,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-26 07:02:35,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=30a55dff90caeeab6740dec2e0d80747, UNASSIGN in 173 msec 2023-09-26 07:02:35,160 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711755160"}]},"ts":"1695711755160"} 2023-09-26 07:02:35,161 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-26 07:02:35,163 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-26 07:02:35,164 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 186 msec 2023-09-26 07:02:35,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-26 07:02:35,284 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-26 07:02:35,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:35,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:35,288 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:35,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:35,289 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:35,290 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39873] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:35,293 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30a55dff90caeeab6740dec2e0d80747 2023-09-26 07:02:35,293 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/68356915f49ce3dcd53ecca9813c1dfc 2023-09-26 07:02:35,293 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:35,293 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:35,293 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:35,293 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:35,293 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c0d7c514e054d33786fec139a242872 2023-09-26 07:02:35,295 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:35,295 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:35,295 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:35,295 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-26 07:02:35,295 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-26 07:02:35,295 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-26 07:02:35,295 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:35,295 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-26 07:02:35,295 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30a55dff90caeeab6740dec2e0d80747/cf, FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30a55dff90caeeab6740dec2e0d80747/recovered.edits] 2023-09-26 07:02:35,295 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-26 07:02:35,295 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-26 07:02:35,295 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-26 07:02:35,296 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-26 07:02:35,296 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/68356915f49ce3dcd53ecca9813c1dfc/cf, FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/68356915f49ce3dcd53ecca9813c1dfc/recovered.edits] 2023-09-26 07:02:35,296 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:35,296 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:35,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-26 07:02:35,296 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:35,297 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:35,297 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c0d7c514e054d33786fec139a242872/cf, FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c0d7c514e054d33786fec139a242872/recovered.edits] 2023-09-26 07:02:35,300 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/68356915f49ce3dcd53ecca9813c1dfc/cf/923f21ac855e427db489925be5979b01 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/68356915f49ce3dcd53ecca9813c1dfc/cf/923f21ac855e427db489925be5979b01 2023-09-26 07:02:35,300 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30a55dff90caeeab6740dec2e0d80747/cf/3be93a05fe2642af8a01bd64a568c167.8c0d7c514e054d33786fec139a242872 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30a55dff90caeeab6740dec2e0d80747/cf/3be93a05fe2642af8a01bd64a568c167.8c0d7c514e054d33786fec139a242872 2023-09-26 07:02:35,301 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c0d7c514e054d33786fec139a242872/cf/3be93a05fe2642af8a01bd64a568c167 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c0d7c514e054d33786fec139a242872/cf/3be93a05fe2642af8a01bd64a568c167 2023-09-26 07:02:35,302 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30a55dff90caeeab6740dec2e0d80747/cf/923f21ac855e427db489925be5979b01.68356915f49ce3dcd53ecca9813c1dfc to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30a55dff90caeeab6740dec2e0d80747/cf/923f21ac855e427db489925be5979b01.68356915f49ce3dcd53ecca9813c1dfc 2023-09-26 07:02:35,304 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/68356915f49ce3dcd53ecca9813c1dfc/recovered.edits/8.seqid to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/68356915f49ce3dcd53ecca9813c1dfc/recovered.edits/8.seqid 2023-09-26 07:02:35,305 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/68356915f49ce3dcd53ecca9813c1dfc 2023-09-26 07:02:35,305 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c0d7c514e054d33786fec139a242872/recovered.edits/8.seqid to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c0d7c514e054d33786fec139a242872/recovered.edits/8.seqid 2023-09-26 07:02:35,306 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30a55dff90caeeab6740dec2e0d80747/recovered.edits/12.seqid to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30a55dff90caeeab6740dec2e0d80747/recovered.edits/12.seqid 2023-09-26 07:02:35,306 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c0d7c514e054d33786fec139a242872 2023-09-26 07:02:35,306 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30a55dff90caeeab6740dec2e0d80747 2023-09-26 07:02:35,306 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-26 07:02:35,308 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:35,311 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-26 07:02:35,312 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-26 07:02:35,313 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:35,313 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-26 07:02:35,314 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695711755313"}]},"ts":"9223372036854775807"} 2023-09-26 07:02:35,315 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-26 07:02:35,315 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 30a55dff90caeeab6740dec2e0d80747, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695711740539.30a55dff90caeeab6740dec2e0d80747.', STARTKEY => '', ENDKEY => ''}] 2023-09-26 07:02:35,315 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-26 07:02:35,315 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695711755315"}]},"ts":"9223372036854775807"} 2023-09-26 07:02:35,317 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-26 07:02:35,318 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:35,320 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 33 msec 2023-09-26 07:02:35,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-26 07:02:35,398 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-26 07:02:35,399 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:35,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:35,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:35,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-26 07:02:35,404 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711755403"}]},"ts":"1695711755403"} 2023-09-26 07:02:35,405 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-26 07:02:35,408 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-26 07:02:35,408 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=68728829bb43a43e00ff99e719792c51, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=143c0e4b33273307e7d01f9c2d825450, UNASSIGN}] 2023-09-26 07:02:35,411 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=143c0e4b33273307e7d01f9c2d825450, UNASSIGN 2023-09-26 07:02:35,411 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=68728829bb43a43e00ff99e719792c51, UNASSIGN 2023-09-26 07:02:35,412 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=68728829bb43a43e00ff99e719792c51, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:35,412 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=143c0e4b33273307e7d01f9c2d825450, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:35,412 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695711755412"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711755412"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711755412"}]},"ts":"1695711755412"} 2023-09-26 07:02:35,412 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695711755412"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711755412"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711755412"}]},"ts":"1695711755412"} 2023-09-26 07:02:35,413 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 68728829bb43a43e00ff99e719792c51, server=jenkins-hbase4.apache.org,39873,1695711667206}] 2023-09-26 07:02:35,414 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 143c0e4b33273307e7d01f9c2d825450, server=jenkins-hbase4.apache.org,32791,1695711667250}] 2023-09-26 07:02:35,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-26 07:02:35,565 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 68728829bb43a43e00ff99e719792c51 2023-09-26 07:02:35,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 68728829bb43a43e00ff99e719792c51, disabling compactions & flushes 2023-09-26 07:02:35,565 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. 2023-09-26 07:02:35,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. 2023-09-26 07:02:35,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. after waiting 0 ms 2023-09-26 07:02:35,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. 2023-09-26 07:02:35,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 143c0e4b33273307e7d01f9c2d825450 2023-09-26 07:02:35,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 143c0e4b33273307e7d01f9c2d825450, disabling compactions & flushes 2023-09-26 07:02:35,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450. 2023-09-26 07:02:35,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450. 2023-09-26 07:02:35,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450. after waiting 0 ms 2023-09-26 07:02:35,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450. 2023-09-26 07:02:35,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/68728829bb43a43e00ff99e719792c51/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 07:02:35,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithMergeRegion/143c0e4b33273307e7d01f9c2d825450/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 07:02:35,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:02:35,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51. 2023-09-26 07:02:35,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 68728829bb43a43e00ff99e719792c51: 2023-09-26 07:02:35,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:02:35,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450. 2023-09-26 07:02:35,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 143c0e4b33273307e7d01f9c2d825450: 2023-09-26 07:02:35,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 68728829bb43a43e00ff99e719792c51 2023-09-26 07:02:35,581 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=68728829bb43a43e00ff99e719792c51, regionState=CLOSED 2023-09-26 07:02:35,581 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695711755581"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711755581"}]},"ts":"1695711755581"} 2023-09-26 07:02:35,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 143c0e4b33273307e7d01f9c2d825450 2023-09-26 07:02:35,581 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=143c0e4b33273307e7d01f9c2d825450, regionState=CLOSED 2023-09-26 07:02:35,582 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695711755581"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711755581"}]},"ts":"1695711755581"} 2023-09-26 07:02:35,584 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-26 07:02:35,584 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 68728829bb43a43e00ff99e719792c51, server=jenkins-hbase4.apache.org,39873,1695711667206 in 169 msec 2023-09-26 07:02:35,585 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-26 07:02:35,585 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 143c0e4b33273307e7d01f9c2d825450, server=jenkins-hbase4.apache.org,32791,1695711667250 in 169 msec 2023-09-26 07:02:35,585 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=68728829bb43a43e00ff99e719792c51, UNASSIGN in 176 msec 2023-09-26 07:02:35,586 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-26 07:02:35,586 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=143c0e4b33273307e7d01f9c2d825450, UNASSIGN in 177 msec 2023-09-26 07:02:35,586 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711755586"}]},"ts":"1695711755586"} 2023-09-26 07:02:35,587 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-26 07:02:35,589 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-26 07:02:35,591 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 191 msec 2023-09-26 07:02:35,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-26 07:02:35,706 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-26 07:02:35,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:35,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:35,710 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:35,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:35,711 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:35,712 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39873] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:35,715 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:35,715 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:35,715 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:35,715 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:35,715 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/68728829bb43a43e00ff99e719792c51 2023-09-26 07:02:35,715 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/143c0e4b33273307e7d01f9c2d825450 2023-09-26 07:02:35,715 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-26 07:02:35,715 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-26 07:02:35,715 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-26 07:02:35,715 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-26 07:02:35,717 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/68728829bb43a43e00ff99e719792c51/cf, FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/68728829bb43a43e00ff99e719792c51/recovered.edits] 2023-09-26 07:02:35,717 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:35,717 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:35,717 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/143c0e4b33273307e7d01f9c2d825450/cf, FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/143c0e4b33273307e7d01f9c2d825450/recovered.edits] 2023-09-26 07:02:35,717 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:35,717 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:35,717 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:35,717 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:35,718 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:35,717 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:35,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-26 07:02:35,721 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/68728829bb43a43e00ff99e719792c51/cf/566de8090c364f4181b892a4772b5f86 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/68728829bb43a43e00ff99e719792c51/cf/566de8090c364f4181b892a4772b5f86 2023-09-26 07:02:35,721 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/143c0e4b33273307e7d01f9c2d825450/cf/b607a50b0f0c4f1896f6ea2ad114b968 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/143c0e4b33273307e7d01f9c2d825450/cf/b607a50b0f0c4f1896f6ea2ad114b968 2023-09-26 07:02:35,724 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/68728829bb43a43e00ff99e719792c51/recovered.edits/9.seqid to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/68728829bb43a43e00ff99e719792c51/recovered.edits/9.seqid 2023-09-26 07:02:35,724 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/143c0e4b33273307e7d01f9c2d825450/recovered.edits/9.seqid to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/143c0e4b33273307e7d01f9c2d825450/recovered.edits/9.seqid 2023-09-26 07:02:35,724 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/68728829bb43a43e00ff99e719792c51 2023-09-26 07:02:35,725 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/143c0e4b33273307e7d01f9c2d825450 2023-09-26 07:02:35,725 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-26 07:02:35,725 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-26 07:02:35,726 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-26 07:02:35,729 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230926fd9b04fcc13d46dd9c6166bad5d50981 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230926fd9b04fcc13d46dd9c6166bad5d50981 2023-09-26 07:02:35,730 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230926b5c355fd28e8446d92dad4531850ceb6 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230926b5c355fd28e8446d92dad4531850ceb6 2023-09-26 07:02:35,730 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-26 07:02:35,732 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:35,734 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-26 07:02:35,736 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-26 07:02:35,737 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:35,737 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-26 07:02:35,737 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695711755737"}]},"ts":"9223372036854775807"} 2023-09-26 07:02:35,737 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695711755737"}]},"ts":"9223372036854775807"} 2023-09-26 07:02:35,739 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-26 07:02:35,739 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 68728829bb43a43e00ff99e719792c51, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695711739175.68728829bb43a43e00ff99e719792c51.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 143c0e4b33273307e7d01f9c2d825450, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695711739175.143c0e4b33273307e7d01f9c2d825450.', STARTKEY => '1', ENDKEY => ''}] 2023-09-26 07:02:35,739 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-26 07:02:35,739 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695711755739"}]},"ts":"9223372036854775807"} 2023-09-26 07:02:35,740 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-26 07:02:35,742 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:35,743 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 35 msec 2023-09-26 07:02:35,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-26 07:02:35,820 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-26 07:02:35,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-26 07:02:35,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:35,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-26 07:02:35,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 07:02:35,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-26 07:02:35,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 07:02:35,860 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1786006679_1 at /127.0.0.1:57552 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x354067f6-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x354067f6-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2080754119_17 at /127.0.0.1:56198 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x354067f6-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3960 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2080754119_17 at /127.0.0.1:47018 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x354067f6-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2080754119_17 at /127.0.0.1:57564 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (631867414) connection to jenkins-hbase4.apache.org/172.31.14.131:46401 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x354067f6-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x354067f6-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=904 (was 904), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=177 (was 200), ProcessCount=168 (was 168), AvailableMemoryMB=4369 (was 4427) 2023-09-26 07:02:35,861 WARN [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-26 07:02:35,880 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=904, MaxFileDescriptor=60000, SystemLoadAverage=177, ProcessCount=168, AvailableMemoryMB=4368 2023-09-26 07:02:35,880 WARN [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-26 07:02:35,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-26 07:02:35,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-26 07:02:35,885 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-26 07:02:35,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-26 07:02:35,885 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-26 07:02:35,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-26 07:02:35,888 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testEmptyExportFileSystemState/297d5b9598dc1aea0bc0f3c899c7561d 2023-09-26 07:02:35,888 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testEmptyExportFileSystemState/c1a41efcfe0e951fc81d843acdd3dacd 2023-09-26 07:02:35,888 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testEmptyExportFileSystemState/297d5b9598dc1aea0bc0f3c899c7561d empty. 2023-09-26 07:02:35,888 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testEmptyExportFileSystemState/c1a41efcfe0e951fc81d843acdd3dacd empty. 2023-09-26 07:02:35,888 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testEmptyExportFileSystemState/297d5b9598dc1aea0bc0f3c899c7561d 2023-09-26 07:02:35,888 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testEmptyExportFileSystemState/c1a41efcfe0e951fc81d843acdd3dacd 2023-09-26 07:02:35,889 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-26 07:02:35,897 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-26 07:02:35,899 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 297d5b9598dc1aea0bc0f3c899c7561d, NAME => 'testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp 2023-09-26 07:02:35,899 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => c1a41efcfe0e951fc81d843acdd3dacd, NAME => 'testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp 2023-09-26 07:02:35,906 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:02:35,907 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 297d5b9598dc1aea0bc0f3c899c7561d, disabling compactions & flushes 2023-09-26 07:02:35,907 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. 2023-09-26 07:02:35,907 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. 2023-09-26 07:02:35,907 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. after waiting 0 ms 2023-09-26 07:02:35,907 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. 2023-09-26 07:02:35,907 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. 2023-09-26 07:02:35,907 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 297d5b9598dc1aea0bc0f3c899c7561d: 2023-09-26 07:02:35,907 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:02:35,907 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing c1a41efcfe0e951fc81d843acdd3dacd, disabling compactions & flushes 2023-09-26 07:02:35,907 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd. 2023-09-26 07:02:35,907 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd. 2023-09-26 07:02:35,907 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd. after waiting 0 ms 2023-09-26 07:02:35,907 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd. 2023-09-26 07:02:35,907 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd. 2023-09-26 07:02:35,907 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for c1a41efcfe0e951fc81d843acdd3dacd: 2023-09-26 07:02:35,909 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-26 07:02:35,910 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695711755910"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711755910"}]},"ts":"1695711755910"} 2023-09-26 07:02:35,910 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695711755910"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711755910"}]},"ts":"1695711755910"} 2023-09-26 07:02:35,912 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-26 07:02:35,912 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-26 07:02:35,913 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711755912"}]},"ts":"1695711755912"} 2023-09-26 07:02:35,914 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-26 07:02:35,917 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-26 07:02:35,918 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-26 07:02:35,918 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-26 07:02:35,918 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-26 07:02:35,918 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-26 07:02:35,918 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=297d5b9598dc1aea0bc0f3c899c7561d, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c1a41efcfe0e951fc81d843acdd3dacd, ASSIGN}] 2023-09-26 07:02:35,921 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=297d5b9598dc1aea0bc0f3c899c7561d, ASSIGN 2023-09-26 07:02:35,921 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c1a41efcfe0e951fc81d843acdd3dacd, ASSIGN 2023-09-26 07:02:35,921 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=297d5b9598dc1aea0bc0f3c899c7561d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42373,1695711667152; forceNewPlan=false, retain=false 2023-09-26 07:02:35,922 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c1a41efcfe0e951fc81d843acdd3dacd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32791,1695711667250; forceNewPlan=false, retain=false 2023-09-26 07:02:35,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-26 07:02:36,072 INFO [jenkins-hbase4:38147] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-26 07:02:36,074 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=c1a41efcfe0e951fc81d843acdd3dacd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,074 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=297d5b9598dc1aea0bc0f3c899c7561d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,075 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695711756074"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711756074"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711756074"}]},"ts":"1695711756074"} 2023-09-26 07:02:36,075 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695711756074"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711756074"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711756074"}]},"ts":"1695711756074"} 2023-09-26 07:02:36,076 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure c1a41efcfe0e951fc81d843acdd3dacd, server=jenkins-hbase4.apache.org,32791,1695711667250}] 2023-09-26 07:02:36,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 297d5b9598dc1aea0bc0f3c899c7561d, server=jenkins-hbase4.apache.org,42373,1695711667152}] 2023-09-26 07:02:36,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-26 07:02:36,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd. 2023-09-26 07:02:36,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c1a41efcfe0e951fc81d843acdd3dacd, NAME => 'testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd.', STARTKEY => '1', ENDKEY => ''} 2023-09-26 07:02:36,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. 2023-09-26 07:02:36,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 297d5b9598dc1aea0bc0f3c899c7561d, NAME => 'testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d.', STARTKEY => '', ENDKEY => '1'} 2023-09-26 07:02:36,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd. service=AccessControlService 2023-09-26 07:02:36,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. service=AccessControlService 2023-09-26 07:02:36,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 07:02:36,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 07:02:36,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 297d5b9598dc1aea0bc0f3c899c7561d 2023-09-26 07:02:36,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState c1a41efcfe0e951fc81d843acdd3dacd 2023-09-26 07:02:36,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:02:36,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:02:36,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 297d5b9598dc1aea0bc0f3c899c7561d 2023-09-26 07:02:36,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c1a41efcfe0e951fc81d843acdd3dacd 2023-09-26 07:02:36,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 297d5b9598dc1aea0bc0f3c899c7561d 2023-09-26 07:02:36,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c1a41efcfe0e951fc81d843acdd3dacd 2023-09-26 07:02:36,234 INFO [StoreOpener-c1a41efcfe0e951fc81d843acdd3dacd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c1a41efcfe0e951fc81d843acdd3dacd 2023-09-26 07:02:36,234 INFO [StoreOpener-297d5b9598dc1aea0bc0f3c899c7561d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 297d5b9598dc1aea0bc0f3c899c7561d 2023-09-26 07:02:36,235 DEBUG [StoreOpener-c1a41efcfe0e951fc81d843acdd3dacd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/c1a41efcfe0e951fc81d843acdd3dacd/cf 2023-09-26 07:02:36,235 DEBUG [StoreOpener-c1a41efcfe0e951fc81d843acdd3dacd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/c1a41efcfe0e951fc81d843acdd3dacd/cf 2023-09-26 07:02:36,236 DEBUG [StoreOpener-297d5b9598dc1aea0bc0f3c899c7561d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/297d5b9598dc1aea0bc0f3c899c7561d/cf 2023-09-26 07:02:36,236 INFO [StoreOpener-c1a41efcfe0e951fc81d843acdd3dacd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c1a41efcfe0e951fc81d843acdd3dacd columnFamilyName cf 2023-09-26 07:02:36,236 DEBUG [StoreOpener-297d5b9598dc1aea0bc0f3c899c7561d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/297d5b9598dc1aea0bc0f3c899c7561d/cf 2023-09-26 07:02:36,236 INFO [StoreOpener-297d5b9598dc1aea0bc0f3c899c7561d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 297d5b9598dc1aea0bc0f3c899c7561d columnFamilyName cf 2023-09-26 07:02:36,238 INFO [StoreOpener-c1a41efcfe0e951fc81d843acdd3dacd-1] regionserver.HStore(310): Store=c1a41efcfe0e951fc81d843acdd3dacd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:02:36,238 INFO [StoreOpener-297d5b9598dc1aea0bc0f3c899c7561d-1] regionserver.HStore(310): Store=297d5b9598dc1aea0bc0f3c899c7561d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:02:36,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/297d5b9598dc1aea0bc0f3c899c7561d 2023-09-26 07:02:36,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/c1a41efcfe0e951fc81d843acdd3dacd 2023-09-26 07:02:36,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/297d5b9598dc1aea0bc0f3c899c7561d 2023-09-26 07:02:36,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/c1a41efcfe0e951fc81d843acdd3dacd 2023-09-26 07:02:36,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 297d5b9598dc1aea0bc0f3c899c7561d 2023-09-26 07:02:36,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c1a41efcfe0e951fc81d843acdd3dacd 2023-09-26 07:02:36,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/297d5b9598dc1aea0bc0f3c899c7561d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 07:02:36,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/c1a41efcfe0e951fc81d843acdd3dacd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 07:02:36,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 297d5b9598dc1aea0bc0f3c899c7561d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74982732, jitterRate=0.11732977628707886}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 07:02:36,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c1a41efcfe0e951fc81d843acdd3dacd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73411242, jitterRate=0.0939127504825592}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 07:02:36,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 297d5b9598dc1aea0bc0f3c899c7561d: 2023-09-26 07:02:36,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c1a41efcfe0e951fc81d843acdd3dacd: 2023-09-26 07:02:36,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd., pid=93, masterSystemTime=1695711756228 2023-09-26 07:02:36,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d., pid=94, masterSystemTime=1695711756229 2023-09-26 07:02:36,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd. 2023-09-26 07:02:36,246 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd. 2023-09-26 07:02:36,247 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=c1a41efcfe0e951fc81d843acdd3dacd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. 2023-09-26 07:02:36,247 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695711756247"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695711756247"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695711756247"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695711756247"}]},"ts":"1695711756247"} 2023-09-26 07:02:36,247 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. 2023-09-26 07:02:36,247 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=297d5b9598dc1aea0bc0f3c899c7561d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,247 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695711756247"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695711756247"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695711756247"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695711756247"}]},"ts":"1695711756247"} 2023-09-26 07:02:36,250 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-26 07:02:36,250 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure c1a41efcfe0e951fc81d843acdd3dacd, server=jenkins-hbase4.apache.org,32791,1695711667250 in 172 msec 2023-09-26 07:02:36,250 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-26 07:02:36,250 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 297d5b9598dc1aea0bc0f3c899c7561d, server=jenkins-hbase4.apache.org,42373,1695711667152 in 172 msec 2023-09-26 07:02:36,251 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c1a41efcfe0e951fc81d843acdd3dacd, ASSIGN in 332 msec 2023-09-26 07:02:36,252 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-26 07:02:36,252 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=297d5b9598dc1aea0bc0f3c899c7561d, ASSIGN in 332 msec 2023-09-26 07:02:36,252 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-26 07:02:36,253 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711756252"}]},"ts":"1695711756252"} 2023-09-26 07:02:36,253 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-26 07:02:36,256 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-26 07:02:36,256 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-26 07:02:36,257 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39873] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-26 07:02:36,259 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:36,259 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:36,259 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:36,259 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:36,260 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:36,260 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:36,260 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:36,260 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:36,261 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 378 msec 2023-09-26 07:02:36,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-26 07:02:36,490 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-26 07:02:36,492 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-26 07:02:36,492 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. 2023-09-26 07:02:36,494 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 07:02:36,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 07:02:36,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695711756504 (current time:1695711756504). 2023-09-26 07:02:36,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 07:02:36,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x48c6f7f2 to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:02:36,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68a7064a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:02:36,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:02:36,519 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60878, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:02:36,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48c6f7f2 to 127.0.0.1:50261 2023-09-26 07:02:36,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:02:36,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x090f2d5a to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:02:36,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@768932ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:02:36,527 DEBUG [hconnection-0x26ccef23-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:02:36,528 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60884, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:02:36,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:02:36,533 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50178, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:02:36,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x090f2d5a to 127.0.0.1:50261 2023-09-26 07:02:36,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:02:36,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-26 07:02:36,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 07:02:36,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 07:02:36,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-26 07:02:36,538 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-26 07:02:36,539 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695712356539 2023-09-26 07:02:36,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 07:02:36,539 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-26 07:02:36,540 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 07:02:36,540 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 07:02:36,541 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-26 07:02:36,542 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-26 07:02:36,542 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-26 07:02:36,545 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-26 07:02:36,546 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695712356546 2023-09-26 07:02:36,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,554 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-26 07:02:36,554 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:36,555 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-26 07:02:36,555 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-26 07:02:36,556 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,556 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,566 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:36,566 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,566 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:36,566 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:36,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:36,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:36,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:36,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:36,567 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:36,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:36,567 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,567 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,567 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 07:02:36,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,568 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-26 07:02:36,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-26 07:02:36,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-26 07:02:36,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,568 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-26 07:02:36,568 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-26 07:02:36,568 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-26 07:02:36,568 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,568 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,568 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,568 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-26 07:02:36,568 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-26 07:02:36,568 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:36,568 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-26 07:02:36,568 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:36,568 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:36,571 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-26 07:02:36,572 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-26 07:02:36,572 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-26 07:02:36,572 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32791,1695711667250' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-26 07:02:36,570 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-26 07:02:36,572 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-26 07:02:36,572 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39873,1695711667206' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-26 07:02:36,572 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-26 07:02:36,572 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42373,1695711667152' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-26 07:02:36,574 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,574 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:36,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:36,575 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,575 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:36,575 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,575 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:02:36,575 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,579 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:36,579 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,580 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:02:36,580 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:02:36,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:36,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:36,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32791,1695711667250' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-26 07:02:36,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@514115f9[Count = 1] remaining members to acquire global barrier 2023-09-26 07:02:36,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:36,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:36,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:36,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:36,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:36,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:36,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42373,1695711667152' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-26 07:02:36,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@514115f9[Count = 0] remaining members to acquire global barrier 2023-09-26 07:02:36,583 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-26 07:02:36,583 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,584 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,584 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,584 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,585 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-26 07:02:36,584 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,585 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:02:36,585 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-26 07:02:36,585 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd. 2023-09-26 07:02:36,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,585 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,585 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-26 07:02:36,585 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-26 07:02:36,585 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. 2023-09-26 07:02:36,585 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 07:02:36,585 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. started... 2023-09-26 07:02:36,585 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:02:36,585 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:02:36,585 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd. started... 2023-09-26 07:02:36,585 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:02:36,585 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 297d5b9598dc1aea0bc0f3c899c7561d: 2023-09-26 07:02:36,585 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39873,1695711667206' in zk 2023-09-26 07:02:36,585 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,587 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c1a41efcfe0e951fc81d843acdd3dacd: 2023-09-26 07:02:36,587 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:02:36,587 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 07:02:36,587 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,587 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:02:36,587 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 07:02:36,589 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-26 07:02:36,589 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:36,589 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-26 07:02:36,595 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd. completed. 2023-09-26 07:02:36,595 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd. 2023-09-26 07:02:36,595 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. completed. 2023-09-26 07:02:36,596 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:02:36,596 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:02:36,596 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,596 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. 2023-09-26 07:02:36,596 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-26 07:02:36,596 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32791,1695711667250' in zk 2023-09-26 07:02:36,596 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:02:36,596 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:02:36,596 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,596 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-26 07:02:36,596 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42373,1695711667152' in zk 2023-09-26 07:02:36,597 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-26 07:02:36,597 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,597 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:36,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:36,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:36,597 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-26 07:02:36,599 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-26 07:02:36,599 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,599 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:36,599 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-26 07:02:36,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:36,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:36,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:36,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:36,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:36,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,32791,1695711667250': 2023-09-26 07:02:36,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32791,1695711667250' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-26 07:02:36,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:36,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:36,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:36,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:36,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:36,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:36,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:36,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42373,1695711667152': 2023-09-26 07:02:36,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42373,1695711667152' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-26 07:02:36,605 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-26 07:02:36,605 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 07:02:36,605 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 07:02:36,605 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,605 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 07:02:36,607 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,607 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,607 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:36,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:36,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:36,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,607 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,607 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,607 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:36,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,607 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,607 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:36,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:36,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:36,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:36,608 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:36,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:36,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:36,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:36,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,608 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:36,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:36,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:36,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,610 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:36,610 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:36,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,610 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:36,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,614 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,614 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,614 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:36,614 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:36,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:36,614 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:36,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:36,614 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:36,614 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:36,614 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:36,614 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:36,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:36,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:36,615 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-26 07:02:36,614 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:36,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:36,614 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:36,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:36,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:36,615 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 07:02:36,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:36,617 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:36,617 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,617 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,617 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:36,617 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,617 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,617 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:36,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:36,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-26 07:02:36,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,641 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:02:36,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-26 07:02:36,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-26 07:02:36,642 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-26 07:02:36,642 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 07:02:36,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,642 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695711756539Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695711756625 (+86 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695711756625Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695711756626 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695711756628 (+2 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695711756636 (+8 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695711756642 (+6 ms) 2023-09-26 07:02:36,648 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-26 07:02:36,649 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 108 msec 2023-09-26 07:02:36,842 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:02:36,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-26 07:02:36,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 07:02:36,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42373] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 07:02:36,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32791] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 07:02:36,849 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-26 07:02:36,850 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. 2023-09-26 07:02:36,850 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 07:02:36,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 07:02:36,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695711756859 (current time:1695711756859). 2023-09-26 07:02:36,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 07:02:36,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x5e9d29fa to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:02:36,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f6970fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:02:36,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:02:36,868 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:02:36,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e9d29fa to 127.0.0.1:50261 2023-09-26 07:02:36,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:02:36,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x43743038 to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:02:36,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74911355, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:02:36,876 DEBUG [hconnection-0x20ab6ba2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:02:36,879 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60898, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:02:36,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:02:36,883 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50184, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:02:36,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43743038 to 127.0.0.1:50261 2023-09-26 07:02:36,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:02:36,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-26 07:02:36,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 07:02:36,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 07:02:36,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-26 07:02:36,887 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-26 07:02:36,888 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695712356888 2023-09-26 07:02:36,888 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-26 07:02:36,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 07:02:36,889 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 07:02:36,890 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-26 07:02:36,890 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 07:02:36,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-26 07:02:36,891 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-26 07:02:36,892 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-26 07:02:36,892 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695712356892 2023-09-26 07:02:36,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,901 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-26 07:02:36,901 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:36,902 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-26 07:02:36,902 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-26 07:02:36,902 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,902 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,903 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:36,903 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:36,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:36,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:36,903 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:36,903 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:36,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:36,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:36,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:36,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,904 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,904 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,904 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-26 07:02:36,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,905 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,905 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 07:02:36,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-26 07:02:36,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,905 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-26 07:02:36,905 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-26 07:02:36,905 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,905 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-26 07:02:36,905 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-26 07:02:36,905 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:36,905 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-26 07:02:36,906 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-26 07:02:36,906 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:36,906 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-26 07:02:36,907 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-26 07:02:36,907 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-26 07:02:36,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,907 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42373,1695711667152' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-26 07:02:36,907 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39873,1695711667206' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-26 07:02:36,907 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-26 07:02:36,908 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,908 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-26 07:02:36,908 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:36,911 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-26 07:02:36,911 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-26 07:02:36,911 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32791,1695711667250' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-26 07:02:36,912 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,912 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:36,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:36,912 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,913 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,913 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:36,913 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,913 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:02:36,913 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,913 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:02:36,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:36,913 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,913 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:02:36,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:36,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:36,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42373,1695711667152' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-26 07:02:36,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bad72f5[Count = 1] remaining members to acquire global barrier 2023-09-26 07:02:36,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:36,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:36,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:36,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:36,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:36,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:36,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32791,1695711667250' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-26 07:02:36,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bad72f5[Count = 0] remaining members to acquire global barrier 2023-09-26 07:02:36,917 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-26 07:02:36,917 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,922 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,922 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,922 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,923 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-26 07:02:36,923 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-26 07:02:36,923 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-26 07:02:36,923 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:36,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,923 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:02:36,923 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39873,1695711667206' in zk 2023-09-26 07:02:36,923 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:02:36,923 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. 2023-09-26 07:02:36,923 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-26 07:02:36,923 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. started... 2023-09-26 07:02:36,923 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:36,923 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 07:02:36,923 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:02:36,923 INFO [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 297d5b9598dc1aea0bc0f3c899c7561d 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-26 07:02:36,923 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd. 2023-09-26 07:02:36,923 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:02:36,923 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd. started... 2023-09-26 07:02:36,924 INFO [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c1a41efcfe0e951fc81d843acdd3dacd 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-26 07:02:36,924 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-26 07:02:36,924 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:36,924 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-26 07:02:36,943 INFO [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230926634dcdb360554ab7a2834c2b597a491d to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230926634dcdb360554ab7a2834c2b597a491d 2023-09-26 07:02:36,943 INFO [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309260c6dfb7cb9cf4efbbe75ad287be7bab4 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309260c6dfb7cb9cf4efbbe75ad287be7bab4 2023-09-26 07:02:36,980 INFO [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/c1a41efcfe0e951fc81d843acdd3dacd/.tmp/cf/5dbd9146c9c14aeeb6e41fdf5168fe8d 2023-09-26 07:02:36,980 INFO [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/297d5b9598dc1aea0bc0f3c899c7561d/.tmp/cf/83b7f8818caf47549a1f4c9b984cc5cd 2023-09-26 07:02:36,985 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/c1a41efcfe0e951fc81d843acdd3dacd/.tmp/cf/5dbd9146c9c14aeeb6e41fdf5168fe8d as hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/c1a41efcfe0e951fc81d843acdd3dacd/cf/5dbd9146c9c14aeeb6e41fdf5168fe8d 2023-09-26 07:02:36,986 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/297d5b9598dc1aea0bc0f3c899c7561d/.tmp/cf/83b7f8818caf47549a1f4c9b984cc5cd as hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/297d5b9598dc1aea0bc0f3c899c7561d/cf/83b7f8818caf47549a1f4c9b984cc5cd 2023-09-26 07:02:36,990 INFO [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/c1a41efcfe0e951fc81d843acdd3dacd/cf/5dbd9146c9c14aeeb6e41fdf5168fe8d, entries=46, sequenceid=6, filesize=12.9 K 2023-09-26 07:02:36,990 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:02:36,990 INFO [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/297d5b9598dc1aea0bc0f3c899c7561d/cf/83b7f8818caf47549a1f4c9b984cc5cd, entries=4, sequenceid=6, filesize=5.6 K 2023-09-26 07:02:36,992 INFO [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 297d5b9598dc1aea0bc0f3c899c7561d in 69ms, sequenceid=6, compaction requested=false 2023-09-26 07:02:36,992 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-26 07:02:36,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-26 07:02:36,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-26 07:02:36,992 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 297d5b9598dc1aea0bc0f3c899c7561d: 2023-09-26 07:02:36,992 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 07:02:36,992 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,992 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:02:36,993 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/297d5b9598dc1aea0bc0f3c899c7561d/cf/83b7f8818caf47549a1f4c9b984cc5cd] hfiles 2023-09-26 07:02:36,993 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/297d5b9598dc1aea0bc0f3c899c7561d/cf/83b7f8818caf47549a1f4c9b984cc5cd for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:36,997 INFO [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for c1a41efcfe0e951fc81d843acdd3dacd in 74ms, sequenceid=6, compaction requested=false 2023-09-26 07:02:37,002 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c1a41efcfe0e951fc81d843acdd3dacd: 2023-09-26 07:02:37,002 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,003 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:02:37,003 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/c1a41efcfe0e951fc81d843acdd3dacd/cf/5dbd9146c9c14aeeb6e41fdf5168fe8d] hfiles 2023-09-26 07:02:37,003 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/c1a41efcfe0e951fc81d843acdd3dacd/cf/5dbd9146c9c14aeeb6e41fdf5168fe8d for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,006 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. completed. 2023-09-26 07:02:37,006 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. 2023-09-26 07:02:37,006 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:02:37,006 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:02:37,006 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:37,006 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-26 07:02:37,006 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42373,1695711667152' in zk 2023-09-26 07:02:37,008 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-26 07:02:37,008 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:37,009 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:37,009 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-26 07:02:37,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:37,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:37,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:37,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:37,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:37,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:37,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:37,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:37,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:37,013 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd. completed. 2023-09-26 07:02:37,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,013 DEBUG [rs(jenkins-hbase4.apache.org,32791,1695711667250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd. 2023-09-26 07:02:37,013 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:02:37,013 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:02:37,013 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:37,013 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-26 07:02:37,013 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32791,1695711667250' in zk 2023-09-26 07:02:37,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:37,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:37,015 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:37,015 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-26 07:02:37,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42373,1695711667152': 2023-09-26 07:02:37,015 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:37,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42373,1695711667152' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-26 07:02:37,015 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-26 07:02:37,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:37,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:37,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:37,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:37,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:37,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:37,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:37,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:37,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:37,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:37,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:37,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:37,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,32791,1695711667250': 2023-09-26 07:02:37,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32791,1695711667250' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-26 07:02:37,020 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-26 07:02:37,020 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 07:02:37,020 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 07:02:37,020 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,020 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 07:02:37,027 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,027 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,027 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:37,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,027 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:37,027 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,027 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,027 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:37,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,027 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:37,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:37,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:37,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:37,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:37,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:37,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:37,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:37,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:37,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:37,028 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:37,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,028 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:37,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:37,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:37,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:37,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:37,030 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:37,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:37,030 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:37,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,031 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:37,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:37,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:37,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:37,033 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:37,033 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,033 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:37,033 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:37,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:37,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:37,033 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:37,033 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:37,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:37,033 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:37,033 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:37,033 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:37,033 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:37,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:37,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:37,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:37,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:37,035 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:37,034 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-26 07:02:37,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:37,035 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:37,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:37,036 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:37,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 07:02:37,036 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:37,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:37,036 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,036 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:37,036 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:37,036 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,036 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309260c6dfb7cb9cf4efbbe75ad287be7bab4, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230926634dcdb360554ab7a2834c2b597a491d] mob files 2023-09-26 07:02:37,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309260c6dfb7cb9cf4efbbe75ad287be7bab4 2023-09-26 07:02:37,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230926634dcdb360554ab7a2834c2b597a491d 2023-09-26 07:02:37,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,067 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-26 07:02:37,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,067 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695711756888Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695711757044 (+156 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695711757044Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695711757044Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695711757047 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695711757060 (+13 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695711757067 (+7 ms) 2023-09-26 07:02:37,070 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-26 07:02:37,071 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 181 msec 2023-09-26 07:02:37,192 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:02:37,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-26 07:02:37,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 07:02:37,194 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711757194 2023-09-26 07:02:37,194 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36301, tgtDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711757194, rawTgtDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711757194, srcFsUri=hdfs://localhost:36301, srcDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1 2023-09-26 07:02:37,216 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36301, inputRoot=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1 2023-09-26 07:02:37,217 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1257306995_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711757194, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711757194/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,217 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36301, inputRoot=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1, snapshotDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-26 07:02:37,222 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711757194/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:37,238 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:37,239 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:37,239 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:37,239 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:38,109 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/hadoop-4802308429242113390.jar 2023-09-26 07:02:38,110 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:38,110 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:38,176 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/hadoop-3139313649702894153.jar 2023-09-26 07:02:38,177 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:38,177 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:38,178 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:38,178 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:38,178 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:38,179 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:38,179 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-26 07:02:38,179 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-26 07:02:38,180 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-26 07:02:38,180 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-26 07:02:38,180 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-26 07:02:38,181 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-26 07:02:38,181 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-26 07:02:38,181 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-26 07:02:38,182 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-26 07:02:38,182 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-26 07:02:38,183 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:02:38,183 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:02:38,184 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 07:02:38,184 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:02:38,184 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:02:38,184 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 07:02:38,185 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 07:02:38,529 WARN [Listener at jenkins-hbase4.apache.org/41375] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-26 07:02:38,531 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-26 07:02:39,138 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 07:02:39,138 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 07:02:39,141 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0005_000001 (auth:SIMPLE) 2023-09-26 07:02:39,717 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0006_000001 (auth:SIMPLE) 2023-09-26 07:02:40,741 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-26 07:02:43,499 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0006_000001 (auth:SIMPLE) 2023-09-26 07:02:45,887 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-26 07:02:45,888 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-26 07:02:45,893 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:45,893 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-26 07:02:45,893 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-26 07:02:45,893 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2080754119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:45,894 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-26 07:02:45,894 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-26 07:02:45,894 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2080754119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711757194/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711757194/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:45,894 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711757194/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-26 07:02:45,894 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711757194/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-26 07:02:45,901 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-26 07:02:45,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-26 07:02:45,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-26 07:02:45,906 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711765906"}]},"ts":"1695711765906"} 2023-09-26 07:02:45,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-26 07:02:45,908 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-26 07:02:45,910 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-26 07:02:45,910 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=297d5b9598dc1aea0bc0f3c899c7561d, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c1a41efcfe0e951fc81d843acdd3dacd, UNASSIGN}] 2023-09-26 07:02:45,913 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=297d5b9598dc1aea0bc0f3c899c7561d, UNASSIGN 2023-09-26 07:02:45,913 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c1a41efcfe0e951fc81d843acdd3dacd, UNASSIGN 2023-09-26 07:02:45,913 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=297d5b9598dc1aea0bc0f3c899c7561d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:45,913 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=c1a41efcfe0e951fc81d843acdd3dacd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:45,913 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695711765913"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711765913"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711765913"}]},"ts":"1695711765913"} 2023-09-26 07:02:45,913 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695711765913"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711765913"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711765913"}]},"ts":"1695711765913"} 2023-09-26 07:02:45,915 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 297d5b9598dc1aea0bc0f3c899c7561d, server=jenkins-hbase4.apache.org,42373,1695711667152}] 2023-09-26 07:02:45,915 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure c1a41efcfe0e951fc81d843acdd3dacd, server=jenkins-hbase4.apache.org,32791,1695711667250}] 2023-09-26 07:02:46,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-26 07:02:46,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 297d5b9598dc1aea0bc0f3c899c7561d 2023-09-26 07:02:46,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c1a41efcfe0e951fc81d843acdd3dacd 2023-09-26 07:02:46,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 297d5b9598dc1aea0bc0f3c899c7561d, disabling compactions & flushes 2023-09-26 07:02:46,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c1a41efcfe0e951fc81d843acdd3dacd, disabling compactions & flushes 2023-09-26 07:02:46,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. 2023-09-26 07:02:46,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd. 2023-09-26 07:02:46,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd. 2023-09-26 07:02:46,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. 2023-09-26 07:02:46,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd. after waiting 0 ms 2023-09-26 07:02:46,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd. 2023-09-26 07:02:46,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. after waiting 0 ms 2023-09-26 07:02:46,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. 2023-09-26 07:02:46,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/297d5b9598dc1aea0bc0f3c899c7561d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 07:02:46,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testEmptyExportFileSystemState/c1a41efcfe0e951fc81d843acdd3dacd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 07:02:46,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:02:46,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:02:46,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d. 2023-09-26 07:02:46,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 297d5b9598dc1aea0bc0f3c899c7561d: 2023-09-26 07:02:46,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd. 2023-09-26 07:02:46,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c1a41efcfe0e951fc81d843acdd3dacd: 2023-09-26 07:02:46,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 297d5b9598dc1aea0bc0f3c899c7561d 2023-09-26 07:02:46,082 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=297d5b9598dc1aea0bc0f3c899c7561d, regionState=CLOSED 2023-09-26 07:02:46,082 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695711766082"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711766082"}]},"ts":"1695711766082"} 2023-09-26 07:02:46,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c1a41efcfe0e951fc81d843acdd3dacd 2023-09-26 07:02:46,083 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=c1a41efcfe0e951fc81d843acdd3dacd, regionState=CLOSED 2023-09-26 07:02:46,083 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695711766083"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711766083"}]},"ts":"1695711766083"} 2023-09-26 07:02:46,085 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-26 07:02:46,085 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 297d5b9598dc1aea0bc0f3c899c7561d, server=jenkins-hbase4.apache.org,42373,1695711667152 in 168 msec 2023-09-26 07:02:46,086 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-26 07:02:46,086 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure c1a41efcfe0e951fc81d843acdd3dacd, server=jenkins-hbase4.apache.org,32791,1695711667250 in 169 msec 2023-09-26 07:02:46,086 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=297d5b9598dc1aea0bc0f3c899c7561d, UNASSIGN in 175 msec 2023-09-26 07:02:46,087 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-26 07:02:46,087 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c1a41efcfe0e951fc81d843acdd3dacd, UNASSIGN in 176 msec 2023-09-26 07:02:46,088 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711766088"}]},"ts":"1695711766088"} 2023-09-26 07:02:46,089 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-26 07:02:46,090 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-26 07:02:46,091 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 189 msec 2023-09-26 07:02:46,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-26 07:02:46,209 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-26 07:02:46,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-26 07:02:46,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-26 07:02:46,213 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-26 07:02:46,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-26 07:02:46,214 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-26 07:02:46,215 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39873] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-26 07:02:46,217 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testEmptyExportFileSystemState/297d5b9598dc1aea0bc0f3c899c7561d 2023-09-26 07:02:46,217 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testEmptyExportFileSystemState/c1a41efcfe0e951fc81d843acdd3dacd 2023-09-26 07:02:46,219 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-26 07:02:46,219 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-26 07:02:46,219 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-26 07:02:46,219 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-26 07:02:46,219 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-26 07:02:46,219 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-26 07:02:46,220 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testEmptyExportFileSystemState/c1a41efcfe0e951fc81d843acdd3dacd/cf, FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testEmptyExportFileSystemState/c1a41efcfe0e951fc81d843acdd3dacd/recovered.edits] 2023-09-26 07:02:46,220 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testEmptyExportFileSystemState/297d5b9598dc1aea0bc0f3c899c7561d/cf, FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testEmptyExportFileSystemState/297d5b9598dc1aea0bc0f3c899c7561d/recovered.edits] 2023-09-26 07:02:46,220 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-26 07:02:46,220 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-26 07:02:46,221 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-26 07:02:46,221 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-26 07:02:46,221 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-26 07:02:46,221 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-26 07:02:46,221 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:46,221 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:46,221 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:46,221 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:46,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-26 07:02:46,224 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testEmptyExportFileSystemState/c1a41efcfe0e951fc81d843acdd3dacd/cf/5dbd9146c9c14aeeb6e41fdf5168fe8d to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testEmptyExportFileSystemState/c1a41efcfe0e951fc81d843acdd3dacd/cf/5dbd9146c9c14aeeb6e41fdf5168fe8d 2023-09-26 07:02:46,224 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testEmptyExportFileSystemState/297d5b9598dc1aea0bc0f3c899c7561d/cf/83b7f8818caf47549a1f4c9b984cc5cd to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testEmptyExportFileSystemState/297d5b9598dc1aea0bc0f3c899c7561d/cf/83b7f8818caf47549a1f4c9b984cc5cd 2023-09-26 07:02:46,227 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testEmptyExportFileSystemState/c1a41efcfe0e951fc81d843acdd3dacd/recovered.edits/9.seqid to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testEmptyExportFileSystemState/c1a41efcfe0e951fc81d843acdd3dacd/recovered.edits/9.seqid 2023-09-26 07:02:46,227 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testEmptyExportFileSystemState/297d5b9598dc1aea0bc0f3c899c7561d/recovered.edits/9.seqid to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testEmptyExportFileSystemState/297d5b9598dc1aea0bc0f3c899c7561d/recovered.edits/9.seqid 2023-09-26 07:02:46,228 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testEmptyExportFileSystemState/c1a41efcfe0e951fc81d843acdd3dacd 2023-09-26 07:02:46,228 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testEmptyExportFileSystemState/297d5b9598dc1aea0bc0f3c899c7561d 2023-09-26 07:02:46,228 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-26 07:02:46,228 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-26 07:02:46,229 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-26 07:02:46,232 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309260c6dfb7cb9cf4efbbe75ad287be7bab4 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309260c6dfb7cb9cf4efbbe75ad287be7bab4 2023-09-26 07:02:46,234 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230926634dcdb360554ab7a2834c2b597a491d to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230926634dcdb360554ab7a2834c2b597a491d 2023-09-26 07:02:46,234 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-26 07:02:46,236 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-26 07:02:46,238 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-26 07:02:46,240 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-26 07:02:46,241 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-26 07:02:46,241 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-26 07:02:46,241 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695711766241"}]},"ts":"9223372036854775807"} 2023-09-26 07:02:46,241 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695711766241"}]},"ts":"9223372036854775807"} 2023-09-26 07:02:46,243 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-26 07:02:46,243 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 297d5b9598dc1aea0bc0f3c899c7561d, NAME => 'testtb-testEmptyExportFileSystemState,,1695711755881.297d5b9598dc1aea0bc0f3c899c7561d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c1a41efcfe0e951fc81d843acdd3dacd, NAME => 'testtb-testEmptyExportFileSystemState,1,1695711755881.c1a41efcfe0e951fc81d843acdd3dacd.', STARTKEY => '1', ENDKEY => ''}] 2023-09-26 07:02:46,243 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-26 07:02:46,243 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695711766243"}]},"ts":"9223372036854775807"} 2023-09-26 07:02:46,244 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-26 07:02:46,246 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-26 07:02:46,247 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 36 msec 2023-09-26 07:02:46,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-26 07:02:46,324 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-26 07:02:46,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-26 07:02:46,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:46,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-26 07:02:46,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-26 07:02:46,360 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 758) Potentially hanging thread: IPC Client (631867414) connection to jenkins-hbase4.apache.org/172.31.14.131:45629 from appattempt_1695711673700_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2080754119_17 at /127.0.0.1:51258 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (631867414) connection to jenkins-hbase4.apache.org/172.31.14.131:46379 from appattempt_1695711673700_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x354067f6-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1958810697_1 at /127.0.0.1:45652 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x354067f6-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1958810697_1 at /127.0.0.1:54152 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2080754119_17 at /127.0.0.1:47734 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x354067f6-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (631867414) connection to jenkins-hbase4.apache.org/172.31.14.131:45499 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x354067f6-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2080754119_17 at /127.0.0.1:39162 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4611 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=944 (was 904) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=165 (was 177), ProcessCount=168 (was 168), AvailableMemoryMB=4302 (was 4368) 2023-09-26 07:02:46,360 WARN [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-26 07:02:46,381 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=944, MaxFileDescriptor=60000, SystemLoadAverage=165, ProcessCount=168, AvailableMemoryMB=4301 2023-09-26 07:02:46,381 WARN [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-26 07:02:46,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-26 07:02:46,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:46,386 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-26 07:02:46,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-26 07:02:46,386 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-26 07:02:46,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-26 07:02:46,388 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/78239e6b53b0984c836a2833735303ea 2023-09-26 07:02:46,388 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/327b590095110e2377cf1eee88476b58 2023-09-26 07:02:46,389 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/78239e6b53b0984c836a2833735303ea empty. 2023-09-26 07:02:46,389 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/327b590095110e2377cf1eee88476b58 empty. 2023-09-26 07:02:46,389 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/78239e6b53b0984c836a2833735303ea 2023-09-26 07:02:46,389 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/327b590095110e2377cf1eee88476b58 2023-09-26 07:02:46,389 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-26 07:02:46,399 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-26 07:02:46,400 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 78239e6b53b0984c836a2833735303ea, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp 2023-09-26 07:02:46,400 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 327b590095110e2377cf1eee88476b58, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp 2023-09-26 07:02:46,416 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:02:46,416 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:02:46,416 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 327b590095110e2377cf1eee88476b58, disabling compactions & flushes 2023-09-26 07:02:46,416 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 78239e6b53b0984c836a2833735303ea, disabling compactions & flushes 2023-09-26 07:02:46,416 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58. 2023-09-26 07:02:46,416 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. 2023-09-26 07:02:46,416 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. 2023-09-26 07:02:46,416 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58. 2023-09-26 07:02:46,416 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. after waiting 0 ms 2023-09-26 07:02:46,416 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. 2023-09-26 07:02:46,416 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58. after waiting 0 ms 2023-09-26 07:02:46,416 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. 2023-09-26 07:02:46,416 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58. 2023-09-26 07:02:46,417 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 78239e6b53b0984c836a2833735303ea: 2023-09-26 07:02:46,417 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58. 2023-09-26 07:02:46,417 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 327b590095110e2377cf1eee88476b58: 2023-09-26 07:02:46,419 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-26 07:02:46,420 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695711766420"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711766420"}]},"ts":"1695711766420"} 2023-09-26 07:02:46,420 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695711766420"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711766420"}]},"ts":"1695711766420"} 2023-09-26 07:02:46,423 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-26 07:02:46,424 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-26 07:02:46,424 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711766424"}]},"ts":"1695711766424"} 2023-09-26 07:02:46,425 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-26 07:02:46,430 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-26 07:02:46,431 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-26 07:02:46,431 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-26 07:02:46,431 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-26 07:02:46,431 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-26 07:02:46,431 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=78239e6b53b0984c836a2833735303ea, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=327b590095110e2377cf1eee88476b58, ASSIGN}] 2023-09-26 07:02:46,434 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=78239e6b53b0984c836a2833735303ea, ASSIGN 2023-09-26 07:02:46,434 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=327b590095110e2377cf1eee88476b58, ASSIGN 2023-09-26 07:02:46,435 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=78239e6b53b0984c836a2833735303ea, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39873,1695711667206; forceNewPlan=false, retain=false 2023-09-26 07:02:46,435 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=327b590095110e2377cf1eee88476b58, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42373,1695711667152; forceNewPlan=false, retain=false 2023-09-26 07:02:46,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-26 07:02:46,585 INFO [jenkins-hbase4:38147] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-26 07:02:46,588 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=327b590095110e2377cf1eee88476b58, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:46,588 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=78239e6b53b0984c836a2833735303ea, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:46,588 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695711766588"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711766588"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711766588"}]},"ts":"1695711766588"} 2023-09-26 07:02:46,589 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695711766588"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711766588"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711766588"}]},"ts":"1695711766588"} 2023-09-26 07:02:46,590 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 327b590095110e2377cf1eee88476b58, server=jenkins-hbase4.apache.org,42373,1695711667152}] 2023-09-26 07:02:46,591 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 78239e6b53b0984c836a2833735303ea, server=jenkins-hbase4.apache.org,39873,1695711667206}] 2023-09-26 07:02:46,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-26 07:02:46,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. 2023-09-26 07:02:46,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58. 2023-09-26 07:02:46,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 78239e6b53b0984c836a2833735303ea, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea.', STARTKEY => '', ENDKEY => '1'} 2023-09-26 07:02:46,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 327b590095110e2377cf1eee88476b58, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58.', STARTKEY => '1', ENDKEY => ''} 2023-09-26 07:02:46,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. service=AccessControlService 2023-09-26 07:02:46,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58. service=AccessControlService 2023-09-26 07:02:46,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 07:02:46,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 07:02:46,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 78239e6b53b0984c836a2833735303ea 2023-09-26 07:02:46,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 327b590095110e2377cf1eee88476b58 2023-09-26 07:02:46,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:02:46,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 07:02:46,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 78239e6b53b0984c836a2833735303ea 2023-09-26 07:02:46,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 327b590095110e2377cf1eee88476b58 2023-09-26 07:02:46,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 78239e6b53b0984c836a2833735303ea 2023-09-26 07:02:46,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 327b590095110e2377cf1eee88476b58 2023-09-26 07:02:46,747 INFO [StoreOpener-327b590095110e2377cf1eee88476b58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 327b590095110e2377cf1eee88476b58 2023-09-26 07:02:46,747 INFO [StoreOpener-78239e6b53b0984c836a2833735303ea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 78239e6b53b0984c836a2833735303ea 2023-09-26 07:02:46,748 DEBUG [StoreOpener-327b590095110e2377cf1eee88476b58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/327b590095110e2377cf1eee88476b58/cf 2023-09-26 07:02:46,748 DEBUG [StoreOpener-78239e6b53b0984c836a2833735303ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/78239e6b53b0984c836a2833735303ea/cf 2023-09-26 07:02:46,748 DEBUG [StoreOpener-327b590095110e2377cf1eee88476b58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/327b590095110e2377cf1eee88476b58/cf 2023-09-26 07:02:46,748 DEBUG [StoreOpener-78239e6b53b0984c836a2833735303ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/78239e6b53b0984c836a2833735303ea/cf 2023-09-26 07:02:46,749 INFO [StoreOpener-327b590095110e2377cf1eee88476b58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 327b590095110e2377cf1eee88476b58 columnFamilyName cf 2023-09-26 07:02:46,749 INFO [StoreOpener-78239e6b53b0984c836a2833735303ea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78239e6b53b0984c836a2833735303ea columnFamilyName cf 2023-09-26 07:02:46,750 INFO [StoreOpener-327b590095110e2377cf1eee88476b58-1] regionserver.HStore(310): Store=327b590095110e2377cf1eee88476b58/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:02:46,750 INFO [StoreOpener-78239e6b53b0984c836a2833735303ea-1] regionserver.HStore(310): Store=78239e6b53b0984c836a2833735303ea/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 07:02:46,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/78239e6b53b0984c836a2833735303ea 2023-09-26 07:02:46,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/327b590095110e2377cf1eee88476b58 2023-09-26 07:02:46,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/78239e6b53b0984c836a2833735303ea 2023-09-26 07:02:46,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/327b590095110e2377cf1eee88476b58 2023-09-26 07:02:46,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 78239e6b53b0984c836a2833735303ea 2023-09-26 07:02:46,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 327b590095110e2377cf1eee88476b58 2023-09-26 07:02:46,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/78239e6b53b0984c836a2833735303ea/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 07:02:46,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/327b590095110e2377cf1eee88476b58/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 07:02:46,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 78239e6b53b0984c836a2833735303ea; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65527424, jitterRate=-0.023565292358398438}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 07:02:46,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 78239e6b53b0984c836a2833735303ea: 2023-09-26 07:02:46,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 327b590095110e2377cf1eee88476b58; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65105419, jitterRate=-0.029853656888008118}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 07:02:46,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 327b590095110e2377cf1eee88476b58: 2023-09-26 07:02:46,757 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea., pid=109, masterSystemTime=1695711766742 2023-09-26 07:02:46,757 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58., pid=108, masterSystemTime=1695711766742 2023-09-26 07:02:46,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. 2023-09-26 07:02:46,759 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. 2023-09-26 07:02:46,759 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=78239e6b53b0984c836a2833735303ea, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:46,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58. 2023-09-26 07:02:46,759 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58. 2023-09-26 07:02:46,759 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695711766759"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695711766759"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695711766759"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695711766759"}]},"ts":"1695711766759"} 2023-09-26 07:02:46,760 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=327b590095110e2377cf1eee88476b58, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:46,760 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695711766760"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695711766760"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695711766760"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695711766760"}]},"ts":"1695711766760"} 2023-09-26 07:02:46,762 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-09-26 07:02:46,762 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 78239e6b53b0984c836a2833735303ea, server=jenkins-hbase4.apache.org,39873,1695711667206 in 170 msec 2023-09-26 07:02:46,763 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-09-26 07:02:46,763 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 327b590095110e2377cf1eee88476b58, server=jenkins-hbase4.apache.org,42373,1695711667152 in 172 msec 2023-09-26 07:02:46,763 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=78239e6b53b0984c836a2833735303ea, ASSIGN in 331 msec 2023-09-26 07:02:46,765 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-26 07:02:46,765 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=327b590095110e2377cf1eee88476b58, ASSIGN in 332 msec 2023-09-26 07:02:46,765 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-26 07:02:46,765 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711766765"}]},"ts":"1695711766765"} 2023-09-26 07:02:46,766 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-26 07:02:46,768 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-26 07:02:46,769 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-26 07:02:46,770 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39873] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-26 07:02:46,771 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:46,771 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:46,771 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:46,771 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:02:46,773 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:46,773 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:46,773 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:46,773 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-26 07:02:46,774 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 390 msec 2023-09-26 07:02:46,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-26 07:02:46,990 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-26 07:02:46,993 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:46,993 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. 2023-09-26 07:02:46,995 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 07:02:47,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-26 07:02:47,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695711767006 (current time:1695711767006). 2023-09-26 07:02:47,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 07:02:47,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x372b3265 to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:02:47,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2153f1fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:02:47,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:02:47,018 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33186, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:02:47,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x372b3265 to 127.0.0.1:50261 2023-09-26 07:02:47,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:02:47,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x25c71fde to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:02:47,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b91a919, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:02:47,027 DEBUG [hconnection-0x75f3658f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:02:47,031 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33194, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:02:47,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:02:47,038 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54120, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:02:47,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25c71fde to 127.0.0.1:50261 2023-09-26 07:02:47,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:02:47,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-26 07:02:47,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 07:02:47,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-26 07:02:47,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-26 07:02:47,043 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-26 07:02:47,043 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695712367043 2023-09-26 07:02:47,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-26 07:02:47,043 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,044 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 07:02:47,045 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 07:02:47,045 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-26 07:02:47,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-26 07:02:47,046 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-26 07:02:47,047 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-26 07:02:47,048 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695712367048 2023-09-26 07:02:47,061 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,061 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-26 07:02:47,061 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:47,063 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-26 07:02:47,063 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-26 07:02:47,063 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,063 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,066 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:47,066 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:47,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:47,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:47,066 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:47,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:47,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:47,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:47,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:47,066 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,067 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,067 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,067 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,067 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 07:02:47,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-26 07:02:47,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-26 07:02:47,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-26 07:02:47,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,067 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-26 07:02:47,067 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-26 07:02:47,067 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-26 07:02:47,068 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,068 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,068 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-26 07:02:47,068 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:47,068 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,069 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-26 07:02:47,069 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-26 07:02:47,069 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:47,068 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-26 07:02:47,070 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-26 07:02:47,071 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-26 07:02:47,069 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-26 07:02:47,071 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42373,1695711667152' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-26 07:02:47,070 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:47,071 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32791,1695711667250' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-26 07:02:47,072 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-26 07:02:47,072 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-26 07:02:47,072 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39873,1695711667206' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-26 07:02:47,077 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,077 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:47,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:47,077 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,077 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,077 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:02:47,077 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:47,077 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,078 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,078 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:02:47,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:47,078 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,078 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:02:47,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:47,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42373,1695711667152' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-26 07:02:47,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@db1a00d[Count = 1] remaining members to acquire global barrier 2023-09-26 07:02:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:47,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:47,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:47,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39873,1695711667206' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-26 07:02:47,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@db1a00d[Count = 0] remaining members to acquire global barrier 2023-09-26 07:02:47,081 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-26 07:02:47,081 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,082 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,082 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,083 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,082 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,083 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-26 07:02:47,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,083 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-26 07:02:47,083 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-26 07:02:47,083 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-26 07:02:47,083 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,083 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 07:02:47,083 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,32791,1695711667250' in zk 2023-09-26 07:02:47,083 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58. 2023-09-26 07:02:47,083 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. 2023-09-26 07:02:47,083 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58. started... 2023-09-26 07:02:47,083 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:02:47,083 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:02:47,083 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:02:47,083 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. started... 2023-09-26 07:02:47,085 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 327b590095110e2377cf1eee88476b58: 2023-09-26 07:02:47,083 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:02:47,085 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 78239e6b53b0984c836a2833735303ea: 2023-09-26 07:02:47,085 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,085 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,085 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:02:47,085 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:02:47,085 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 07:02:47,085 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 07:02:47,087 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-26 07:02:47,088 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:47,088 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-26 07:02:47,098 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58. completed. 2023-09-26 07:02:47,098 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58. 2023-09-26 07:02:47,098 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:02:47,098 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:02:47,098 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,098 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-26 07:02:47,098 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42373,1695711667152' in zk 2023-09-26 07:02:47,100 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,100 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-26 07:02:47,100 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:47,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:47,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:47,100 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-26 07:02:47,102 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. completed. 2023-09-26 07:02:47,102 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. 2023-09-26 07:02:47,102 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:02:47,102 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:02:47,102 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:47,102 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-26 07:02:47,102 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39873,1695711667206' in zk 2023-09-26 07:02:47,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:47,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,104 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,104 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-26 07:02:47,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,104 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:47,104 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-26 07:02:47,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:47,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42373,1695711667152': 2023-09-26 07:02:47,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42373,1695711667152' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-26 07:02:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:47,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39873,1695711667206': 2023-09-26 07:02:47,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39873,1695711667206' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-26 07:02:47,111 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-26 07:02:47,111 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 07:02:47,111 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 07:02:47,111 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,111 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 07:02:47,112 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,112 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,112 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:47,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:47,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,113 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:47,112 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:47,112 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,113 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:47,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:47,113 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:47,113 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:47,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:47,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:47,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:47,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:47,114 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:47,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,115 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:47,116 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,116 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,119 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:47,119 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:47,119 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:47,119 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:47,119 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,119 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:47,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:47,119 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:47,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:47,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:47,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:47,119 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,119 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:47,123 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:47,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:47,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:47,123 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,121 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:47,123 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:47,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 07:02:47,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:47,123 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,123 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,123 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,123 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,123 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,123 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,123 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:47,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:47,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-26 07:02:47,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,145 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:02:47,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-26 07:02:47,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-26 07:02:47,146 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 07:02:47,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,146 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-26 07:02:47,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,147 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,147 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695711767043Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695711767130 (+87 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695711767130Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695711767131 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695711767134 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695711767141 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695711767146 (+5 ms) 2023-09-26 07:02:47,150 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-26 07:02:47,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 106 msec 2023-09-26 07:02:47,346 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:02:47,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-26 07:02:47,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 07:02:47,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39873] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 07:02:47,350 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42373] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 07:02:47,352 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,352 DEBUG [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. 2023-09-26 07:02:47,352 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 07:02:47,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-26 07:02:47,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695711767361 (current time:1695711767361). 2023-09-26 07:02:47,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 07:02:47,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x2986913f to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:02:47,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4737569d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:02:47,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:02:47,373 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33200, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:02:47,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2986913f to 127.0.0.1:50261 2023-09-26 07:02:47,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:02:47,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(139): Connect 0x7ceb4a3b to 127.0.0.1:50261 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 07:02:47,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61f933f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 07:02:47,381 DEBUG [hconnection-0x1c8712ec-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:02:47,382 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:02:47,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 07:02:47,392 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54128, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 07:02:47,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ceb4a3b to 127.0.0.1:50261 2023-09-26 07:02:47,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:02:47,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-26 07:02:47,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 07:02:47,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-26 07:02:47,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-26 07:02:47,397 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-26 07:02:47,397 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695712367397 2023-09-26 07:02:47,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-26 07:02:47,397 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,399 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 07:02:47,399 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 07:02:47,400 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-26 07:02:47,400 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-26 07:02:47,401 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-26 07:02:47,402 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-26 07:02:47,402 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695712367402 2023-09-26 07:02:47,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,411 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-26 07:02:47,411 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:47,412 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-26 07:02:47,412 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-26 07:02:47,413 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,413 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,414 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:47,414 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:47,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:47,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:47,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:47,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:47,414 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,414 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:47,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:47,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:47,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,414 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,414 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,415 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,415 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,415 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,415 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-26 07:02:47,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,415 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 07:02:47,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-26 07:02:47,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-26 07:02:47,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-26 07:02:47,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-26 07:02:47,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-26 07:02:47,415 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-26 07:02:47,415 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:47,418 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-26 07:02:47,418 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-26 07:02:47,418 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,418 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32791,1695711667250' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-26 07:02:47,418 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-26 07:02:47,418 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,418 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:47,418 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-26 07:02:47,419 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-26 07:02:47,419 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-26 07:02:47,419 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39873,1695711667206' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-26 07:02:47,419 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 07:02:47,421 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-26 07:02:47,421 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-26 07:02:47,421 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42373,1695711667152' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-26 07:02:47,422 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,422 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,422 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:47,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:47,424 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,424 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:47,424 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,424 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,424 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:02:47,424 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:02:47,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:47,425 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,425 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 07:02:47,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:47,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39873,1695711667206' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-26 07:02:47,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@625acceb[Count = 1] remaining members to acquire global barrier 2023-09-26 07:02:47,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:47,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:47,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:47,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:47,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:47,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42373,1695711667152' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-26 07:02:47,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@625acceb[Count = 0] remaining members to acquire global barrier 2023-09-26 07:02:47,428 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-26 07:02:47,428 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,431 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,431 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,431 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,431 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-26 07:02:47,431 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,432 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-26 07:02:47,432 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:02:47,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,432 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:02:47,432 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-26 07:02:47,432 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58. 2023-09-26 07:02:47,432 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-26 07:02:47,432 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58. started... 2023-09-26 07:02:47,432 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 07:02:47,432 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. 2023-09-26 07:02:47,432 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,32791,1695711667250' in zk 2023-09-26 07:02:47,432 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,432 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 07:02:47,432 INFO [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 327b590095110e2377cf1eee88476b58 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-26 07:02:47,432 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. started... 2023-09-26 07:02:47,432 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 07:02:47,432 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 78239e6b53b0984c836a2833735303ea 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-26 07:02:47,433 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-26 07:02:47,433 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:47,433 DEBUG [member: 'jenkins-hbase4.apache.org,32791,1695711667250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-26 07:02:47,460 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230926af5c915fe2d2416da800f01fc882f52f to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230926af5c915fe2d2416da800f01fc882f52f 2023-09-26 07:02:47,461 INFO [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230926177d7c02612a48b48be09de30198f86a to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230926177d7c02612a48b48be09de30198f86a 2023-09-26 07:02:47,474 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/78239e6b53b0984c836a2833735303ea/.tmp/cf/f4ba9b1ca68140d984049140d05e4f49 2023-09-26 07:02:47,474 INFO [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/327b590095110e2377cf1eee88476b58/.tmp/cf/f08a789c376d47fd84778d2bbbb8de32 2023-09-26 07:02:47,481 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/327b590095110e2377cf1eee88476b58/.tmp/cf/f08a789c376d47fd84778d2bbbb8de32 as hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/327b590095110e2377cf1eee88476b58/cf/f08a789c376d47fd84778d2bbbb8de32 2023-09-26 07:02:47,481 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/78239e6b53b0984c836a2833735303ea/.tmp/cf/f4ba9b1ca68140d984049140d05e4f49 as hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/78239e6b53b0984c836a2833735303ea/cf/f4ba9b1ca68140d984049140d05e4f49 2023-09-26 07:02:47,486 INFO [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/327b590095110e2377cf1eee88476b58/cf/f08a789c376d47fd84778d2bbbb8de32, entries=47, sequenceid=6, filesize=13.4 K 2023-09-26 07:02:47,487 INFO [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 327b590095110e2377cf1eee88476b58 in 55ms, sequenceid=6, compaction requested=false 2023-09-26 07:02:47,487 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/78239e6b53b0984c836a2833735303ea/cf/f4ba9b1ca68140d984049140d05e4f49, entries=3, sequenceid=6, filesize=5.4 K 2023-09-26 07:02:47,487 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-26 07:02:47,488 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 327b590095110e2377cf1eee88476b58: 2023-09-26 07:02:47,488 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,488 INFO [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 78239e6b53b0984c836a2833735303ea in 56ms, sequenceid=6, compaction requested=false 2023-09-26 07:02:47,488 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:02:47,490 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/327b590095110e2377cf1eee88476b58/cf/f08a789c376d47fd84778d2bbbb8de32] hfiles 2023-09-26 07:02:47,490 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/327b590095110e2377cf1eee88476b58/cf/f08a789c376d47fd84778d2bbbb8de32 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,490 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 78239e6b53b0984c836a2833735303ea: 2023-09-26 07:02:47,490 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,490 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 07:02:47,490 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/78239e6b53b0984c836a2833735303ea/cf/f4ba9b1ca68140d984049140d05e4f49] hfiles 2023-09-26 07:02:47,490 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/78239e6b53b0984c836a2833735303ea/cf/f4ba9b1ca68140d984049140d05e4f49 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,499 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:02:47,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-26 07:02:47,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-26 07:02:47,500 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 07:02:47,502 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58. completed. 2023-09-26 07:02:47,502 DEBUG [rs(jenkins-hbase4.apache.org,42373,1695711667152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58. 2023-09-26 07:02:47,502 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. completed. 2023-09-26 07:02:47,502 DEBUG [rs(jenkins-hbase4.apache.org,39873,1695711667206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. 2023-09-26 07:02:47,502 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:02:47,502 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 07:02:47,502 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:02:47,502 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 07:02:47,502 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,502 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,502 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-26 07:02:47,502 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-26 07:02:47,502 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39873,1695711667206' in zk 2023-09-26 07:02:47,502 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42373,1695711667152' in zk 2023-09-26 07:02:47,504 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-26 07:02:47,504 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,504 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:47,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:47,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:47,504 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-26 07:02:47,504 DEBUG [member: 'jenkins-hbase4.apache.org,42373,1695711667152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-26 07:02:47,506 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:47,504 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,506 DEBUG [member: 'jenkins-hbase4.apache.org,39873,1695711667206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-26 07:02:47,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:47,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:47,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:47,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42373,1695711667152': 2023-09-26 07:02:47,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42373,1695711667152' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-26 07:02:47,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:47,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:47,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:47,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:47,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:47,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39873,1695711667206': 2023-09-26 07:02:47,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39873,1695711667206' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-26 07:02:47,513 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-26 07:02:47,513 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 07:02:47,514 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 07:02:47,514 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,514 INFO [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 07:02:47,515 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,515 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,515 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,515 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,515 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:47,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,515 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:47,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,515 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:47,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 07:02:47,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 07:02:47,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:47,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:47,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:47,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:47,516 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:47,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:47,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 07:02:47,517 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,517 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 07:02:47,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,519 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 07:02:47,519 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,519 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,523 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,523 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,523 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:47,523 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:47,523 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 07:02:47,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:47,523 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:47,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:47,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:47,523 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:47,523 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 07:02:47,523 DEBUG [(jenkins-hbase4.apache.org,38147,1695711665890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 07:02:47,523 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:47,523 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 07:02:47,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:47,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:47,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:47,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 07:02:47,524 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,523 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,526 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 07:02:47,526 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:02:47,526 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,526 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:02:47,526 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:02:47,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:47,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 07:02:47,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 07:02:47,526 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,526 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230926177d7c02612a48b48be09de30198f86a, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230926af5c915fe2d2416da800f01fc882f52f] mob files 2023-09-26 07:02:47,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230926177d7c02612a48b48be09de30198f86a 2023-09-26 07:02:47,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230926af5c915fe2d2416da800f01fc882f52f 2023-09-26 07:02:47,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,551 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-26 07:02:47,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,551 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695711767398Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695711767533 (+135 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695711767533Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695711767533Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695711767536 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695711767544 (+8 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695711767551 (+7 ms) 2023-09-26 07:02:47,554 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-26 07:02:47,555 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 156 msec 2023-09-26 07:02:47,700 DEBUG [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 07:02:47,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-26 07:02:47,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 07:02:47,702 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711767702 2023-09-26 07:02:47,702 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36301, tgtDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711767702, rawTgtDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711767702, srcFsUri=hdfs://localhost:36301, srcDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1 2023-09-26 07:02:47,724 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36301, inputRoot=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1 2023-09-26 07:02:47,724 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1703560196_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711767702, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711767702/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,725 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36301, inputRoot=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1, snapshotDir=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-26 07:02:47,737 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711767702/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:02:47,751 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:47,751 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:47,751 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:47,752 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:48,621 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/hadoop-9075380887901093400.jar 2023-09-26 07:02:48,622 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:48,622 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:48,688 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/hadoop-1280823340155753257.jar 2023-09-26 07:02:48,689 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:48,689 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:48,689 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:48,690 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:48,690 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:48,690 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-26 07:02:48,691 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-26 07:02:48,691 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-26 07:02:48,691 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-26 07:02:48,692 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-26 07:02:48,692 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-26 07:02:48,692 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-26 07:02:48,693 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-26 07:02:48,693 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-26 07:02:48,693 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-26 07:02:48,694 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-26 07:02:48,694 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:02:48,695 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:02:48,695 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 07:02:48,695 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:02:48,696 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 07:02:48,696 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 07:02:48,697 DEBUG [Listener at jenkins-hbase4.apache.org/41375] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 07:02:49,054 WARN [Listener at jenkins-hbase4.apache.org/41375] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-26 07:02:49,056 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-26 07:02:49,058 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-26 07:02:50,808 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 07:02:50,808 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 07:02:50,811 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0006_000001 (auth:SIMPLE) 2023-09-26 07:02:51,159 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0007_000001 (auth:SIMPLE) 2023-09-26 07:02:51,668 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-26 07:02:55,003 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0007_000001 (auth:SIMPLE) 2023-09-26 07:02:57,231 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0007_000001 (auth:SIMPLE) 2023-09-26 07:02:59,839 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695711673700_0007_000001 (auth:SIMPLE) 2023-09-26 07:03:01,226 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-26 07:03:01,226 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-26 07:03:01,237 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,237 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-26 07:03:01,238 INFO [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-26 07:03:01,238 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2080754119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,238 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-26 07:03:01,238 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-26 07:03:01,238 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2080754119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711767702/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711767702/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,239 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711767702/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-26 07:03:01,239 DEBUG [Listener at jenkins-hbase4.apache.org/41375] snapshot.TestExportSnapshot(367): hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/export-test/export-1695711767702/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-26 07:03:01,244 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-26 07:03:01,249 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711781249"}]},"ts":"1695711781249"} 2023-09-26 07:03:01,250 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-26 07:03:01,251 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-26 07:03:01,252 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=78239e6b53b0984c836a2833735303ea, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=327b590095110e2377cf1eee88476b58, UNASSIGN}] 2023-09-26 07:03:01,254 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=78239e6b53b0984c836a2833735303ea, UNASSIGN 2023-09-26 07:03:01,254 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=327b590095110e2377cf1eee88476b58, UNASSIGN 2023-09-26 07:03:01,255 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=78239e6b53b0984c836a2833735303ea, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:03:01,255 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=327b590095110e2377cf1eee88476b58, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:03:01,255 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695711781255"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711781255"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711781255"}]},"ts":"1695711781255"} 2023-09-26 07:03:01,255 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695711781255"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695711781255"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695711781255"}]},"ts":"1695711781255"} 2023-09-26 07:03:01,256 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 78239e6b53b0984c836a2833735303ea, server=jenkins-hbase4.apache.org,39873,1695711667206}] 2023-09-26 07:03:01,257 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 327b590095110e2377cf1eee88476b58, server=jenkins-hbase4.apache.org,42373,1695711667152}] 2023-09-26 07:03:01,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-26 07:03:01,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 78239e6b53b0984c836a2833735303ea 2023-09-26 07:03:01,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 78239e6b53b0984c836a2833735303ea, disabling compactions & flushes 2023-09-26 07:03:01,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. 2023-09-26 07:03:01,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. 2023-09-26 07:03:01,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. after waiting 0 ms 2023-09-26 07:03:01,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. 2023-09-26 07:03:01,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 327b590095110e2377cf1eee88476b58 2023-09-26 07:03:01,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 327b590095110e2377cf1eee88476b58, disabling compactions & flushes 2023-09-26 07:03:01,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58. 2023-09-26 07:03:01,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58. 2023-09-26 07:03:01,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58. after waiting 0 ms 2023-09-26 07:03:01,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58. 2023-09-26 07:03:01,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/327b590095110e2377cf1eee88476b58/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 07:03:01,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/default/testtb-testExportFileSystemStateWithSkipTmp/78239e6b53b0984c836a2833735303ea/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 07:03:01,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:03:01,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:03:01,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58. 2023-09-26 07:03:01,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea. 2023-09-26 07:03:01,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 327b590095110e2377cf1eee88476b58: 2023-09-26 07:03:01,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 78239e6b53b0984c836a2833735303ea: 2023-09-26 07:03:01,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 78239e6b53b0984c836a2833735303ea 2023-09-26 07:03:01,425 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=78239e6b53b0984c836a2833735303ea, regionState=CLOSED 2023-09-26 07:03:01,425 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695711781425"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711781425"}]},"ts":"1695711781425"} 2023-09-26 07:03:01,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 327b590095110e2377cf1eee88476b58 2023-09-26 07:03:01,426 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=327b590095110e2377cf1eee88476b58, regionState=CLOSED 2023-09-26 07:03:01,426 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695711781426"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695711781426"}]},"ts":"1695711781426"} 2023-09-26 07:03:01,428 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-26 07:03:01,428 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 78239e6b53b0984c836a2833735303ea, server=jenkins-hbase4.apache.org,39873,1695711667206 in 170 msec 2023-09-26 07:03:01,429 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-26 07:03:01,429 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 327b590095110e2377cf1eee88476b58, server=jenkins-hbase4.apache.org,42373,1695711667152 in 170 msec 2023-09-26 07:03:01,429 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=78239e6b53b0984c836a2833735303ea, UNASSIGN in 176 msec 2023-09-26 07:03:01,430 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-26 07:03:01,430 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=327b590095110e2377cf1eee88476b58, UNASSIGN in 177 msec 2023-09-26 07:03:01,431 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695711781431"}]},"ts":"1695711781431"} 2023-09-26 07:03:01,432 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-26 07:03:01,433 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-26 07:03:01,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 189 msec 2023-09-26 07:03:01,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-26 07:03:01,551 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-26 07:03:01,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,555 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,555 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,557 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39873] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,559 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/78239e6b53b0984c836a2833735303ea 2023-09-26 07:03:01,559 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/327b590095110e2377cf1eee88476b58 2023-09-26 07:03:01,560 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,560 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,560 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,560 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,560 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-26 07:03:01,560 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-26 07:03:01,560 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-26 07:03:01,561 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,561 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:03:01,561 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-09-26 07:03:01,561 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-26 07:03:01,562 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,562 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:03:01,562 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:03:01,562 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,562 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 07:03:01,562 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/78239e6b53b0984c836a2833735303ea/cf, FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/78239e6b53b0984c836a2833735303ea/recovered.edits] 2023-09-26 07:03:01,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-26 07:03:01,563 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/327b590095110e2377cf1eee88476b58/cf, FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/327b590095110e2377cf1eee88476b58/recovered.edits] 2023-09-26 07:03:01,567 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/78239e6b53b0984c836a2833735303ea/cf/f4ba9b1ca68140d984049140d05e4f49 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/78239e6b53b0984c836a2833735303ea/cf/f4ba9b1ca68140d984049140d05e4f49 2023-09-26 07:03:01,567 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/327b590095110e2377cf1eee88476b58/cf/f08a789c376d47fd84778d2bbbb8de32 to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/327b590095110e2377cf1eee88476b58/cf/f08a789c376d47fd84778d2bbbb8de32 2023-09-26 07:03:01,570 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/78239e6b53b0984c836a2833735303ea/recovered.edits/9.seqid to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/78239e6b53b0984c836a2833735303ea/recovered.edits/9.seqid 2023-09-26 07:03:01,571 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/78239e6b53b0984c836a2833735303ea 2023-09-26 07:03:01,571 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/327b590095110e2377cf1eee88476b58/recovered.edits/9.seqid to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/327b590095110e2377cf1eee88476b58/recovered.edits/9.seqid 2023-09-26 07:03:01,571 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/327b590095110e2377cf1eee88476b58 2023-09-26 07:03:01,571 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-26 07:03:01,572 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-26 07:03:01,572 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-26 07:03:01,575 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230926177d7c02612a48b48be09de30198f86a to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230926177d7c02612a48b48be09de30198f86a 2023-09-26 07:03:01,577 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230926af5c915fe2d2416da800f01fc882f52f to hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230926af5c915fe2d2416da800f01fc882f52f 2023-09-26 07:03:01,577 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-26 07:03:01,579 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,581 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-26 07:03:01,583 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-26 07:03:01,584 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,584 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-26 07:03:01,584 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695711781584"}]},"ts":"9223372036854775807"} 2023-09-26 07:03:01,584 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695711781584"}]},"ts":"9223372036854775807"} 2023-09-26 07:03:01,586 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-26 07:03:01,586 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 78239e6b53b0984c836a2833735303ea, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695711766382.78239e6b53b0984c836a2833735303ea.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 327b590095110e2377cf1eee88476b58, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695711766382.327b590095110e2377cf1eee88476b58.', STARTKEY => '1', ENDKEY => ''}] 2023-09-26 07:03:01,586 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-26 07:03:01,586 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695711781586"}]},"ts":"9223372036854775807"} 2023-09-26 07:03:01,587 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-26 07:03:01,590 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,591 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 38 msec 2023-09-26 07:03:01,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-26 07:03:01,664 INFO [Listener at jenkins-hbase4.apache.org/41375] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-26 07:03:01,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-26 07:03:01,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-26 07:03:01,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38147] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 07:03:01,700 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 765), OpenFileDescriptor=909 (was 944), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=182 (was 165) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=4259 (was 4301) 2023-09-26 07:03:01,700 WARN [Listener at jenkins-hbase4.apache.org/41375] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-26 07:03:01,700 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-26 07:03:01,711 INFO [Listener at jenkins-hbase4.apache.org/41375] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-26 07:03:01,822 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695711673700_0007_01_000001 is : 143 2023-09-26 07:03:06,991 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-26 07:03:15,834 INFO [Listener at jenkins-hbase4.apache.org/41375] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-26 07:03:29,949 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-26 07:03:29,949 INFO [Listener at jenkins-hbase4.apache.org/41375] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-26 07:03:30,058 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-26 07:03:30,066 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-26 07:03:30,067 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-26 07:03:30,076 INFO [Listener at jenkins-hbase4.apache.org/41375] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-26 07:03:30,180 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-26 07:03:30,180 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-26 07:03:30,180 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-26 07:03:30,180 INFO [Listener at jenkins-hbase4.apache.org/41375] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-26 07:03:30,180 DEBUG [Listener at jenkins-hbase4.apache.org/41375] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ac64c89 to 127.0.0.1:50261 2023-09-26 07:03:30,180 DEBUG [Listener at jenkins-hbase4.apache.org/41375] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:03:30,180 DEBUG [Listener at jenkins-hbase4.apache.org/41375] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-26 07:03:30,181 DEBUG [Listener at jenkins-hbase4.apache.org/41375] util.JVMClusterUtil(257): Found active master hash=999023071, stopped=false 2023-09-26 07:03:30,181 DEBUG [Listener at jenkins-hbase4.apache.org/41375] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:03:30,181 DEBUG [Listener at jenkins-hbase4.apache.org/41375] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-26 07:03:30,181 INFO [Listener at jenkins-hbase4.apache.org/41375] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38147,1695711665890 2023-09-26 07:03:30,183 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-26 07:03:30,183 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-26 07:03:30,183 INFO [Listener at jenkins-hbase4.apache.org/41375] procedure2.ProcedureExecutor(628): Stopping 2023-09-26 07:03:30,183 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-26 07:03:30,183 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-26 07:03:30,183 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-26 07:03:30,183 DEBUG [Listener at jenkins-hbase4.apache.org/41375] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08901546 to 127.0.0.1:50261 2023-09-26 07:03:30,183 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-26 07:03:30,183 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-26 07:03:30,183 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-26 07:03:30,183 DEBUG [Listener at jenkins-hbase4.apache.org/41375] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:03:30,183 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-26 07:03:30,184 INFO [Listener at jenkins-hbase4.apache.org/41375] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42373,1695711667152' ***** 2023-09-26 07:03:30,184 DEBUG [Listener at jenkins-hbase4.apache.org/41375] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:03:30,184 INFO [Listener at jenkins-hbase4.apache.org/41375] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-26 07:03:30,184 INFO [Listener at jenkins-hbase4.apache.org/41375] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39873,1695711667206' ***** 2023-09-26 07:03:30,184 DEBUG [Listener at jenkins-hbase4.apache.org/41375] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:03:30,184 INFO [Listener at jenkins-hbase4.apache.org/41375] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-26 07:03:30,184 INFO [RS:0;jenkins-hbase4:42373] regionserver.HeapMemoryManager(220): Stopping 2023-09-26 07:03:30,184 INFO [Listener at jenkins-hbase4.apache.org/41375] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,32791,1695711667250' ***** 2023-09-26 07:03:30,184 INFO [RS:0;jenkins-hbase4:42373] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-26 07:03:30,184 DEBUG [Listener at jenkins-hbase4.apache.org/41375] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:03:30,184 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-26 07:03:30,184 INFO [RS:1;jenkins-hbase4:39873] regionserver.HeapMemoryManager(220): Stopping 2023-09-26 07:03:30,184 INFO [Listener at jenkins-hbase4.apache.org/41375] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-26 07:03:30,184 INFO [RS:0;jenkins-hbase4:42373] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-26 07:03:30,185 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-26 07:03:30,185 INFO [RS:2;jenkins-hbase4:32791] regionserver.HeapMemoryManager(220): Stopping 2023-09-26 07:03:30,185 INFO [RS:1;jenkins-hbase4:39873] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-26 07:03:30,185 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-26 07:03:30,185 INFO [RS:2;jenkins-hbase4:32791] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-26 07:03:30,185 INFO [RS:0;jenkins-hbase4:42373] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:03:30,185 INFO [RS:2;jenkins-hbase4:32791] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-26 07:03:30,185 DEBUG [RS:0;jenkins-hbase4:42373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x749237b6 to 127.0.0.1:50261 2023-09-26 07:03:30,185 INFO [RS:2;jenkins-hbase4:32791] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:03:30,185 INFO [RS:1;jenkins-hbase4:39873] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-26 07:03:30,185 DEBUG [RS:2;jenkins-hbase4:32791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ddad224 to 127.0.0.1:50261 2023-09-26 07:03:30,185 DEBUG [RS:0;jenkins-hbase4:42373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:03:30,185 DEBUG [RS:2;jenkins-hbase4:32791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:03:30,188 INFO [RS:1;jenkins-hbase4:39873] regionserver.HRegionServer(3305): Received CLOSE for 5f9d9a63d6b0e101954a6975eabb7425 2023-09-26 07:03:30,188 INFO [RS:0;jenkins-hbase4:42373] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42373,1695711667152; all regions closed. 2023-09-26 07:03:30,188 INFO [RS:2;jenkins-hbase4:32791] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-26 07:03:30,188 INFO [RS:2;jenkins-hbase4:32791] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-26 07:03:30,188 INFO [RS:2;jenkins-hbase4:32791] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-26 07:03:30,188 INFO [RS:2;jenkins-hbase4:32791] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-26 07:03:30,189 INFO [RS:1;jenkins-hbase4:39873] regionserver.HRegionServer(3305): Received CLOSE for bb54fa38fdc696cab3c00cf554adfe8d 2023-09-26 07:03:30,189 INFO [RS:1;jenkins-hbase4:39873] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:03:30,189 DEBUG [RS:1;jenkins-hbase4:39873] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3954eb73 to 127.0.0.1:50261 2023-09-26 07:03:30,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5f9d9a63d6b0e101954a6975eabb7425, disabling compactions & flushes 2023-09-26 07:03:30,189 DEBUG [RS:1;jenkins-hbase4:39873] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:03:30,189 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425. 2023-09-26 07:03:30,190 INFO [RS:1;jenkins-hbase4:39873] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-26 07:03:30,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425. 2023-09-26 07:03:30,190 DEBUG [RS:1;jenkins-hbase4:39873] regionserver.HRegionServer(1478): Online Regions={5f9d9a63d6b0e101954a6975eabb7425=hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425., bb54fa38fdc696cab3c00cf554adfe8d=hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d.} 2023-09-26 07:03:30,189 INFO [RS:2;jenkins-hbase4:32791] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-26 07:03:30,190 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-26 07:03:30,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425. after waiting 0 ms 2023-09-26 07:03:30,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425. 2023-09-26 07:03:30,190 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-26 07:03:30,190 DEBUG [RS:2;jenkins-hbase4:32791] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-09-26 07:03:30,191 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-26 07:03:30,191 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5f9d9a63d6b0e101954a6975eabb7425 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-26 07:03:30,191 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-26 07:03:30,191 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-26 07:03:30,191 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-26 07:03:30,191 DEBUG [RS:1;jenkins-hbase4:39873] regionserver.HRegionServer(1504): Waiting on 5f9d9a63d6b0e101954a6975eabb7425, bb54fa38fdc696cab3c00cf554adfe8d 2023-09-26 07:03:30,191 DEBUG [RS:2;jenkins-hbase4:32791] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-09-26 07:03:30,206 DEBUG [RS:0;jenkins-hbase4:42373] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/oldWALs 2023-09-26 07:03:30,207 INFO [RS:0;jenkins-hbase4:42373] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42373%2C1695711667152:(num 1695711668918) 2023-09-26 07:03:30,207 DEBUG [RS:0;jenkins-hbase4:42373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:03:30,207 INFO [RS:0;jenkins-hbase4:42373] regionserver.LeaseManager(133): Closed leases 2023-09-26 07:03:30,207 INFO [RS:0;jenkins-hbase4:42373] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-26 07:03:30,207 INFO [RS:0;jenkins-hbase4:42373] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-26 07:03:30,207 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-26 07:03:30,207 INFO [RS:0;jenkins-hbase4:42373] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-26 07:03:30,208 INFO [RS:0;jenkins-hbase4:42373] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-26 07:03:30,209 INFO [RS:0;jenkins-hbase4:42373] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42373 2023-09-26 07:03:30,214 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/namespace/5f9d9a63d6b0e101954a6975eabb7425/.tmp/info/ddbc1f9eff394e7d8f5ee6fb1ee88d36 2023-09-26 07:03:30,216 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-26 07:03:30,216 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:03:30,216 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:03:30,216 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-26 07:03:30,216 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42373,1695711667152 2023-09-26 07:03:30,216 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-26 07:03:30,216 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42373,1695711667152] 2023-09-26 07:03:30,216 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-26 07:03:30,217 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42373,1695711667152; numProcessing=1 2023-09-26 07:03:30,218 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740/.tmp/info/ab3b393949ab419b98c1de98ee99980d 2023-09-26 07:03:30,219 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42373,1695711667152 already deleted, retry=false 2023-09-26 07:03:30,219 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42373,1695711667152 expired; onlineServers=2 2023-09-26 07:03:30,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/namespace/5f9d9a63d6b0e101954a6975eabb7425/.tmp/info/ddbc1f9eff394e7d8f5ee6fb1ee88d36 as hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/namespace/5f9d9a63d6b0e101954a6975eabb7425/info/ddbc1f9eff394e7d8f5ee6fb1ee88d36 2023-09-26 07:03:30,222 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab3b393949ab419b98c1de98ee99980d 2023-09-26 07:03:30,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/namespace/5f9d9a63d6b0e101954a6975eabb7425/info/ddbc1f9eff394e7d8f5ee6fb1ee88d36, entries=2, sequenceid=6, filesize=4.8 K 2023-09-26 07:03:30,227 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 5f9d9a63d6b0e101954a6975eabb7425 in 37ms, sequenceid=6, compaction requested=false 2023-09-26 07:03:30,227 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-26 07:03:30,227 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-26 07:03:30,227 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-26 07:03:30,234 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740/.tmp/rep_barrier/0ba18392ccf240daac475d570fa54285 2023-09-26 07:03:30,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/namespace/5f9d9a63d6b0e101954a6975eabb7425/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 07:03:30,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:03:30,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425. 2023-09-26 07:03:30,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5f9d9a63d6b0e101954a6975eabb7425: 2023-09-26 07:03:30,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695711669368.5f9d9a63d6b0e101954a6975eabb7425. 2023-09-26 07:03:30,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bb54fa38fdc696cab3c00cf554adfe8d, disabling compactions & flushes 2023-09-26 07:03:30,237 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d. 2023-09-26 07:03:30,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d. 2023-09-26 07:03:30,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d. after waiting 0 ms 2023-09-26 07:03:30,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d. 2023-09-26 07:03:30,238 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing bb54fa38fdc696cab3c00cf554adfe8d 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-26 07:03:30,239 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ba18392ccf240daac475d570fa54285 2023-09-26 07:03:30,247 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/acl/bb54fa38fdc696cab3c00cf554adfe8d/.tmp/l/6a40d4d218b444f480577b1e5d75a990 2023-09-26 07:03:30,248 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740/.tmp/table/b849e7cbf843496ea4eb63dcd0ee9856 2023-09-26 07:03:30,251 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a40d4d218b444f480577b1e5d75a990 2023-09-26 07:03:30,252 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b849e7cbf843496ea4eb63dcd0ee9856 2023-09-26 07:03:30,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/acl/bb54fa38fdc696cab3c00cf554adfe8d/.tmp/l/6a40d4d218b444f480577b1e5d75a990 as hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/acl/bb54fa38fdc696cab3c00cf554adfe8d/l/6a40d4d218b444f480577b1e5d75a990 2023-09-26 07:03:30,253 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740/.tmp/info/ab3b393949ab419b98c1de98ee99980d as hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740/info/ab3b393949ab419b98c1de98ee99980d 2023-09-26 07:03:30,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a40d4d218b444f480577b1e5d75a990 2023-09-26 07:03:30,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/acl/bb54fa38fdc696cab3c00cf554adfe8d/l/6a40d4d218b444f480577b1e5d75a990, entries=7, sequenceid=18, filesize=5.2 K 2023-09-26 07:03:30,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for bb54fa38fdc696cab3c00cf554adfe8d in 21ms, sequenceid=18, compaction requested=false 2023-09-26 07:03:30,259 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab3b393949ab419b98c1de98ee99980d 2023-09-26 07:03:30,259 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740/info/ab3b393949ab419b98c1de98ee99980d, entries=48, sequenceid=131, filesize=10.3 K 2023-09-26 07:03:30,262 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740/.tmp/rep_barrier/0ba18392ccf240daac475d570fa54285 as hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740/rep_barrier/0ba18392ccf240daac475d570fa54285 2023-09-26 07:03:30,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/acl/bb54fa38fdc696cab3c00cf554adfe8d/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-26 07:03:30,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:03:30,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d. 2023-09-26 07:03:30,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bb54fa38fdc696cab3c00cf554adfe8d: 2023-09-26 07:03:30,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695711670120.bb54fa38fdc696cab3c00cf554adfe8d. 2023-09-26 07:03:30,268 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ba18392ccf240daac475d570fa54285 2023-09-26 07:03:30,268 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740/rep_barrier/0ba18392ccf240daac475d570fa54285, entries=13, sequenceid=131, filesize=6.4 K 2023-09-26 07:03:30,269 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740/.tmp/table/b849e7cbf843496ea4eb63dcd0ee9856 as hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740/table/b849e7cbf843496ea4eb63dcd0ee9856 2023-09-26 07:03:30,274 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b849e7cbf843496ea4eb63dcd0ee9856 2023-09-26 07:03:30,274 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740/table/b849e7cbf843496ea4eb63dcd0ee9856, entries=24, sequenceid=131, filesize=6.9 K 2023-09-26 07:03:30,275 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 84ms, sequenceid=131, compaction requested=false 2023-09-26 07:03:30,287 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-26 07:03:30,288 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 07:03:30,288 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-26 07:03:30,288 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-26 07:03:30,288 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-26 07:03:30,289 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-26 07:03:30,318 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-26 07:03:30,318 INFO [RS:0;jenkins-hbase4:42373] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42373,1695711667152; zookeeper connection closed. 2023-09-26 07:03:30,318 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:42373-0x100e709d2ca0001, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-26 07:03:30,318 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2bca790e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2bca790e 2023-09-26 07:03:30,391 INFO [RS:1;jenkins-hbase4:39873] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39873,1695711667206; all regions closed. 2023-09-26 07:03:30,391 INFO [RS:2;jenkins-hbase4:32791] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,32791,1695711667250; all regions closed. 2023-09-26 07:03:30,400 DEBUG [RS:2;jenkins-hbase4:32791] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/oldWALs 2023-09-26 07:03:30,400 DEBUG [RS:1;jenkins-hbase4:39873] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/oldWALs 2023-09-26 07:03:30,400 INFO [RS:2;jenkins-hbase4:32791] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C32791%2C1695711667250.meta:.meta(num 1695711669058) 2023-09-26 07:03:30,400 INFO [RS:1;jenkins-hbase4:39873] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39873%2C1695711667206:(num 1695711668918) 2023-09-26 07:03:30,400 DEBUG [RS:1;jenkins-hbase4:39873] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:03:30,400 INFO [RS:1;jenkins-hbase4:39873] regionserver.LeaseManager(133): Closed leases 2023-09-26 07:03:30,400 INFO [RS:1;jenkins-hbase4:39873] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-26 07:03:30,401 INFO [RS:1;jenkins-hbase4:39873] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-26 07:03:30,401 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-26 07:03:30,401 INFO [RS:1;jenkins-hbase4:39873] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-26 07:03:30,401 INFO [RS:1;jenkins-hbase4:39873] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-26 07:03:30,402 INFO [RS:1;jenkins-hbase4:39873] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39873 2023-09-26 07:03:30,405 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:03:30,405 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-26 07:03:30,405 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39873,1695711667206 2023-09-26 07:03:30,406 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39873,1695711667206] 2023-09-26 07:03:30,406 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39873,1695711667206; numProcessing=2 2023-09-26 07:03:30,407 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39873,1695711667206 already deleted, retry=false 2023-09-26 07:03:30,407 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39873,1695711667206 expired; onlineServers=1 2023-09-26 07:03:30,408 DEBUG [RS:2;jenkins-hbase4:32791] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/oldWALs 2023-09-26 07:03:30,408 INFO [RS:2;jenkins-hbase4:32791] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C32791%2C1695711667250:(num 1695711668918) 2023-09-26 07:03:30,408 DEBUG [RS:2;jenkins-hbase4:32791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:03:30,408 INFO [RS:2;jenkins-hbase4:32791] regionserver.LeaseManager(133): Closed leases 2023-09-26 07:03:30,408 INFO [RS:2;jenkins-hbase4:32791] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-26 07:03:30,408 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-26 07:03:30,409 INFO [RS:2;jenkins-hbase4:32791] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:32791 2023-09-26 07:03:30,411 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32791,1695711667250 2023-09-26 07:03:30,411 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-26 07:03:30,412 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,32791,1695711667250] 2023-09-26 07:03:30,412 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,32791,1695711667250; numProcessing=3 2023-09-26 07:03:30,414 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,32791,1695711667250 already deleted, retry=false 2023-09-26 07:03:30,414 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,32791,1695711667250 expired; onlineServers=0 2023-09-26 07:03:30,414 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38147,1695711665890' ***** 2023-09-26 07:03:30,414 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-26 07:03:30,414 DEBUG [M:0;jenkins-hbase4:38147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ab6ebe4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-26 07:03:30,414 INFO [M:0;jenkins-hbase4:38147] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38147,1695711665890 2023-09-26 07:03:30,414 INFO [M:0;jenkins-hbase4:38147] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38147,1695711665890; all regions closed. 2023-09-26 07:03:30,414 DEBUG [M:0;jenkins-hbase4:38147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 07:03:30,414 DEBUG [M:0;jenkins-hbase4:38147] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-26 07:03:30,414 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-26 07:03:30,414 DEBUG [M:0;jenkins-hbase4:38147] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-26 07:03:30,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695711668532] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695711668532,5,FailOnTimeoutGroup] 2023-09-26 07:03:30,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695711668533] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695711668533,5,FailOnTimeoutGroup] 2023-09-26 07:03:30,414 INFO [M:0;jenkins-hbase4:38147] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-26 07:03:30,414 INFO [M:0;jenkins-hbase4:38147] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-26 07:03:30,415 INFO [M:0;jenkins-hbase4:38147] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-26 07:03:30,415 DEBUG [M:0;jenkins-hbase4:38147] master.HMaster(1512): Stopping service threads 2023-09-26 07:03:30,415 INFO [M:0;jenkins-hbase4:38147] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-26 07:03:30,415 ERROR [M:0;jenkins-hbase4:38147] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-13,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-26 07:03:30,415 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-26 07:03:30,415 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-26 07:03:30,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-26 07:03:30,416 INFO [M:0;jenkins-hbase4:38147] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-26 07:03:30,416 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-26 07:03:30,416 DEBUG [M:0;jenkins-hbase4:38147] zookeeper.ZKUtil(398): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-26 07:03:30,416 WARN [M:0;jenkins-hbase4:38147] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-26 07:03:30,416 INFO [M:0;jenkins-hbase4:38147] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-26 07:03:30,416 INFO [M:0;jenkins-hbase4:38147] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-26 07:03:30,417 DEBUG [M:0;jenkins-hbase4:38147] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-26 07:03:30,417 INFO [M:0;jenkins-hbase4:38147] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-26 07:03:30,417 DEBUG [M:0;jenkins-hbase4:38147] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-26 07:03:30,417 DEBUG [M:0;jenkins-hbase4:38147] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-26 07:03:30,417 DEBUG [M:0;jenkins-hbase4:38147] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-26 07:03:30,417 INFO [M:0;jenkins-hbase4:38147] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.67 KB heapSize=451.94 KB 2023-09-26 07:03:30,432 INFO [M:0;jenkins-hbase4:38147] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.67 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/fef2d534e1f746e1b620611e2cccf4c6 2023-09-26 07:03:30,437 INFO [M:0;jenkins-hbase4:38147] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fef2d534e1f746e1b620611e2cccf4c6 2023-09-26 07:03:30,438 DEBUG [M:0;jenkins-hbase4:38147] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/fef2d534e1f746e1b620611e2cccf4c6 as hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/fef2d534e1f746e1b620611e2cccf4c6 2023-09-26 07:03:30,442 INFO [M:0;jenkins-hbase4:38147] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fef2d534e1f746e1b620611e2cccf4c6 2023-09-26 07:03:30,442 INFO [M:0;jenkins-hbase4:38147] regionserver.HStore(1080): Added hdfs://localhost:36301/user/jenkins/test-data/9af646df-729b-a2eb-4002-2b312c1d2aa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/fef2d534e1f746e1b620611e2cccf4c6, entries=119, sequenceid=899, filesize=28.6 K 2023-09-26 07:03:30,443 INFO [M:0;jenkins-hbase4:38147] regionserver.HRegion(2948): Finished flush of dataSize ~375.67 KB/384691, heapSize ~451.92 KB/462768, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=899, compaction requested=false 2023-09-26 07:03:30,444 INFO [M:0;jenkins-hbase4:38147] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-26 07:03:30,445 DEBUG [M:0;jenkins-hbase4:38147] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-26 07:03:30,448 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-26 07:03:30,448 INFO [M:0;jenkins-hbase4:38147] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-26 07:03:30,449 INFO [M:0;jenkins-hbase4:38147] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38147 2023-09-26 07:03:30,451 DEBUG [M:0;jenkins-hbase4:38147] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38147,1695711665890 already deleted, retry=false 2023-09-26 07:03:30,507 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-26 07:03:30,507 INFO [RS:1;jenkins-hbase4:39873] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39873,1695711667206; zookeeper connection closed. 2023-09-26 07:03:30,507 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:39873-0x100e709d2ca0002, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-26 07:03:30,507 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@675a9309] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@675a9309 2023-09-26 07:03:30,607 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-26 07:03:30,607 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): master:38147-0x100e709d2ca0000, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-26 07:03:30,607 INFO [M:0;jenkins-hbase4:38147] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38147,1695711665890; zookeeper connection closed. 2023-09-26 07:03:30,707 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-26 07:03:30,707 INFO [RS:2;jenkins-hbase4:32791] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,32791,1695711667250; zookeeper connection closed. 2023-09-26 07:03:30,707 DEBUG [Listener at localhost/33837-EventThread] zookeeper.ZKWatcher(600): regionserver:32791-0x100e709d2ca0003, quorum=127.0.0.1:50261, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-26 07:03:30,708 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@702a6350] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@702a6350 2023-09-26 07:03:30,708 INFO [Listener at jenkins-hbase4.apache.org/41375] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-26 07:03:30,708 WARN [Listener at jenkins-hbase4.apache.org/41375] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-26 07:03:30,712 INFO [Listener at jenkins-hbase4.apache.org/41375] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-26 07:03:30,816 WARN [BP-1886450212-172.31.14.131-1695711662063 heartbeating to localhost/127.0.0.1:36301] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-26 07:03:30,816 WARN [BP-1886450212-172.31.14.131-1695711662063 heartbeating to localhost/127.0.0.1:36301] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1886450212-172.31.14.131-1695711662063 (Datanode Uuid 529aaa97-60bb-4876-89f9-207f04b36d1c) service to localhost/127.0.0.1:36301 2023-09-26 07:03:30,818 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/cluster_4e183e78-ccf4-5782-402b-e9b6bcc58056/dfs/data/data5/current/BP-1886450212-172.31.14.131-1695711662063] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-26 07:03:30,818 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/cluster_4e183e78-ccf4-5782-402b-e9b6bcc58056/dfs/data/data6/current/BP-1886450212-172.31.14.131-1695711662063] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-26 07:03:30,819 WARN [Listener at jenkins-hbase4.apache.org/41375] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-26 07:03:30,822 INFO [Listener at jenkins-hbase4.apache.org/41375] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-26 07:03:30,925 WARN [BP-1886450212-172.31.14.131-1695711662063 heartbeating to localhost/127.0.0.1:36301] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-26 07:03:30,926 WARN [BP-1886450212-172.31.14.131-1695711662063 heartbeating to localhost/127.0.0.1:36301] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1886450212-172.31.14.131-1695711662063 (Datanode Uuid db609152-d400-46c1-960f-4c86258958f0) service to localhost/127.0.0.1:36301 2023-09-26 07:03:30,926 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/cluster_4e183e78-ccf4-5782-402b-e9b6bcc58056/dfs/data/data3/current/BP-1886450212-172.31.14.131-1695711662063] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-26 07:03:30,927 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/cluster_4e183e78-ccf4-5782-402b-e9b6bcc58056/dfs/data/data4/current/BP-1886450212-172.31.14.131-1695711662063] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-26 07:03:30,927 WARN [Listener at jenkins-hbase4.apache.org/41375] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-26 07:03:30,929 INFO [Listener at jenkins-hbase4.apache.org/41375] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-26 07:03:31,033 WARN [BP-1886450212-172.31.14.131-1695711662063 heartbeating to localhost/127.0.0.1:36301] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-26 07:03:31,033 WARN [BP-1886450212-172.31.14.131-1695711662063 heartbeating to localhost/127.0.0.1:36301] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1886450212-172.31.14.131-1695711662063 (Datanode Uuid f2f50bba-2a0c-4a7d-a15d-ea61879e7122) service to localhost/127.0.0.1:36301 2023-09-26 07:03:31,034 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/cluster_4e183e78-ccf4-5782-402b-e9b6bcc58056/dfs/data/data1/current/BP-1886450212-172.31.14.131-1695711662063] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-26 07:03:31,034 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4592b4dc-1421-ef5a-ec22-f976f369dd9d/cluster_4e183e78-ccf4-5782-402b-e9b6bcc58056/dfs/data/data2/current/BP-1886450212-172.31.14.131-1695711662063] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-26 07:03:31,054 INFO [Listener at jenkins-hbase4.apache.org/41375] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-26 07:03:31,183 INFO [Listener at jenkins-hbase4.apache.org/41375] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-26 07:03:31,276 INFO [Listener at jenkins-hbase4.apache.org/41375] hbase.HBaseTestingUtility(1293): Minicluster is down