2023-07-23 10:06:00,470 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-23 10:06:00,712 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181 2023-07-23 10:06:00,713 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-23 10:06:00,752 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-23 10:06:01,000 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-23 10:06:01,001 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/cluster_bd390da2-1551-9369-9467-7621abdbc80d, deleteOnExit=true 2023-07-23 10:06:01,001 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-23 10:06:01,002 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/test.cache.data in system properties and HBase conf 2023-07-23 10:06:01,002 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/hadoop.tmp.dir in system properties and HBase conf 2023-07-23 10:06:01,003 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/hadoop.log.dir in system properties and HBase conf 2023-07-23 10:06:01,003 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-23 10:06:01,004 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-23 10:06:01,004 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-23 10:06:01,396 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-23 10:06:01,402 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-23 10:06:01,402 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-23 10:06:01,403 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-23 10:06:01,403 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 10:06:01,403 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-23 10:06:01,404 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-23 10:06:01,407 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 10:06:01,409 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 10:06:01,409 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-23 10:06:01,410 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/nfs.dump.dir in system properties and HBase conf 2023-07-23 10:06:01,410 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/java.io.tmpdir in system properties and HBase conf 2023-07-23 10:06:01,410 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 10:06:01,411 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-23 10:06:01,411 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-23 10:06:02,038 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-23 10:06:02,042 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-23 10:06:02,320 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-23 10:06:02,502 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-23 10:06:02,515 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 10:06:02,551 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 10:06:02,584 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/java.io.tmpdir/Jetty_localhost_43031_hdfs____bbelax/webapp 2023-07-23 10:06:02,744 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43031 2023-07-23 10:06:02,783 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-23 10:06:02,784 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-23 10:06:03,334 WARN [Listener at localhost/39321] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 10:06:03,428 WARN [Listener at localhost/39321] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-23 10:06:03,453 WARN [Listener at localhost/39321] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 10:06:03,461 INFO [Listener at localhost/39321] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 10:06:03,468 INFO [Listener at localhost/39321] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/java.io.tmpdir/Jetty_localhost_36585_datanode____.qe26ei/webapp 2023-07-23 10:06:03,592 INFO [Listener at localhost/39321] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36585 2023-07-23 10:06:04,136 WARN [Listener at localhost/38221] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 10:06:04,182 WARN [Listener at localhost/38221] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-23 10:06:04,187 WARN [Listener at localhost/38221] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 10:06:04,189 INFO [Listener at localhost/38221] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 10:06:04,200 INFO [Listener at localhost/38221] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/java.io.tmpdir/Jetty_localhost_37485_datanode____b9jagk/webapp 2023-07-23 10:06:04,344 INFO [Listener at localhost/38221] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37485 2023-07-23 10:06:04,377 WARN [Listener at localhost/40661] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 10:06:04,416 WARN [Listener at localhost/40661] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-23 10:06:04,421 WARN [Listener at localhost/40661] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 10:06:04,424 INFO [Listener at localhost/40661] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 10:06:04,429 INFO [Listener at localhost/40661] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/java.io.tmpdir/Jetty_localhost_37331_datanode____.nhevfw/webapp 2023-07-23 10:06:04,578 INFO [Listener at localhost/40661] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37331 2023-07-23 10:06:04,610 WARN [Listener at localhost/36111] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 10:06:04,867 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x935aaa5aeff1a1ec: Processing first storage report for DS-1bf4399c-dcd7-4c07-b54c-131f66a28c53 from datanode ea0dbdab-18b5-414d-a068-45972d395ad1 2023-07-23 10:06:04,869 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x935aaa5aeff1a1ec: from storage DS-1bf4399c-dcd7-4c07-b54c-131f66a28c53 node DatanodeRegistration(127.0.0.1:33687, datanodeUuid=ea0dbdab-18b5-414d-a068-45972d395ad1, infoPort=34745, infoSecurePort=0, ipcPort=40661, storageInfo=lv=-57;cid=testClusterID;nsid=621924130;c=1690106762116), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-23 10:06:04,870 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe8bb3eda970eecfc: Processing first storage report for DS-d8033750-5b73-4439-94a7-9d34cfbdd874 from datanode 654462dd-3c5e-4e67-8502-51b8a1082004 2023-07-23 10:06:04,870 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe8bb3eda970eecfc: from storage DS-d8033750-5b73-4439-94a7-9d34cfbdd874 node DatanodeRegistration(127.0.0.1:39101, datanodeUuid=654462dd-3c5e-4e67-8502-51b8a1082004, infoPort=46471, infoSecurePort=0, ipcPort=38221, storageInfo=lv=-57;cid=testClusterID;nsid=621924130;c=1690106762116), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 10:06:04,870 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x935aaa5aeff1a1ec: Processing first storage report for DS-64900fd7-7d00-4669-b68b-80995dd81769 from datanode ea0dbdab-18b5-414d-a068-45972d395ad1 2023-07-23 10:06:04,870 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x935aaa5aeff1a1ec: from storage DS-64900fd7-7d00-4669-b68b-80995dd81769 node DatanodeRegistration(127.0.0.1:33687, datanodeUuid=ea0dbdab-18b5-414d-a068-45972d395ad1, infoPort=34745, infoSecurePort=0, ipcPort=40661, storageInfo=lv=-57;cid=testClusterID;nsid=621924130;c=1690106762116), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 10:06:04,870 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe8bb3eda970eecfc: Processing first storage report for DS-1bb26ce7-6167-4e21-a2ac-831190745c3d from datanode 654462dd-3c5e-4e67-8502-51b8a1082004 2023-07-23 10:06:04,871 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe8bb3eda970eecfc: from storage DS-1bb26ce7-6167-4e21-a2ac-831190745c3d node DatanodeRegistration(127.0.0.1:39101, datanodeUuid=654462dd-3c5e-4e67-8502-51b8a1082004, infoPort=46471, infoSecurePort=0, ipcPort=38221, storageInfo=lv=-57;cid=testClusterID;nsid=621924130;c=1690106762116), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-23 10:06:04,873 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcdc3c2cdf8927ef2: Processing first storage report for DS-e387ecee-d624-4f11-8e10-bc0f88b0faf1 from datanode d5760c75-5569-430d-92d5-456423779f47 2023-07-23 10:06:04,873 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcdc3c2cdf8927ef2: from storage DS-e387ecee-d624-4f11-8e10-bc0f88b0faf1 node DatanodeRegistration(127.0.0.1:37725, datanodeUuid=d5760c75-5569-430d-92d5-456423779f47, infoPort=37797, infoSecurePort=0, ipcPort=36111, storageInfo=lv=-57;cid=testClusterID;nsid=621924130;c=1690106762116), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-23 10:06:04,874 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcdc3c2cdf8927ef2: Processing first storage report for DS-af0f9dd6-2677-47fb-9dae-dce0fb8f03b9 from datanode d5760c75-5569-430d-92d5-456423779f47 2023-07-23 10:06:04,874 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcdc3c2cdf8927ef2: from storage DS-af0f9dd6-2677-47fb-9dae-dce0fb8f03b9 node DatanodeRegistration(127.0.0.1:37725, datanodeUuid=d5760c75-5569-430d-92d5-456423779f47, infoPort=37797, infoSecurePort=0, ipcPort=36111, storageInfo=lv=-57;cid=testClusterID;nsid=621924130;c=1690106762116), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 10:06:05,127 DEBUG [Listener at localhost/36111] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181 2023-07-23 10:06:05,212 INFO [Listener at localhost/36111] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/cluster_bd390da2-1551-9369-9467-7621abdbc80d/zookeeper_0, clientPort=61286, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/cluster_bd390da2-1551-9369-9467-7621abdbc80d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/cluster_bd390da2-1551-9369-9467-7621abdbc80d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-23 10:06:05,231 INFO [Listener at localhost/36111] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61286 2023-07-23 10:06:05,244 INFO [Listener at localhost/36111] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 10:06:05,246 INFO [Listener at localhost/36111] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 10:06:05,946 INFO [Listener at localhost/36111] util.FSUtils(471): Created version file at hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa with version=8 2023-07-23 10:06:05,946 INFO [Listener at localhost/36111] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/hbase-staging 2023-07-23 10:06:06,329 INFO [Listener at localhost/36111] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-23 10:06:06,965 INFO [Listener at localhost/36111] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 10:06:07,014 INFO [Listener at localhost/36111] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,014 INFO [Listener at localhost/36111] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,015 INFO [Listener at localhost/36111] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 10:06:07,015 INFO [Listener at localhost/36111] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,015 INFO [Listener at localhost/36111] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 10:06:07,188 INFO [Listener at localhost/36111] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 10:06:07,273 DEBUG [Listener at localhost/36111] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-23 10:06:07,379 INFO [Listener at localhost/36111] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39043 2023-07-23 10:06:07,396 INFO [Listener at localhost/36111] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 10:06:07,399 INFO [Listener at localhost/36111] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 10:06:07,423 INFO [Listener at localhost/36111] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39043 connecting to ZooKeeper ensemble=127.0.0.1:61286 2023-07-23 10:06:07,480 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:390430x0, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 10:06:07,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:39043-0x10191a5228d0000 connected 2023-07-23 10:06:07,530 DEBUG [Listener at localhost/36111] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 10:06:07,532 DEBUG [Listener at localhost/36111] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 10:06:07,547 DEBUG [Listener at localhost/36111] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 10:06:07,562 DEBUG [Listener at localhost/36111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39043 2023-07-23 10:06:07,564 DEBUG [Listener at localhost/36111] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39043 2023-07-23 10:06:07,566 DEBUG [Listener at localhost/36111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39043 2023-07-23 10:06:07,570 DEBUG [Listener at localhost/36111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39043 2023-07-23 10:06:07,571 DEBUG [Listener at localhost/36111] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39043 2023-07-23 10:06:07,579 INFO [Listener at localhost/36111] master.HMaster(444): hbase.rootdir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa, hbase.cluster.distributed=false 2023-07-23 10:06:07,668 INFO [Listener at localhost/36111] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 10:06:07,668 INFO [Listener at localhost/36111] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,669 INFO [Listener at localhost/36111] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,669 INFO [Listener at localhost/36111] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 10:06:07,669 INFO [Listener at localhost/36111] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,669 INFO [Listener at localhost/36111] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 10:06:07,677 INFO [Listener at localhost/36111] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 10:06:07,681 INFO [Listener at localhost/36111] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43301 2023-07-23 10:06:07,685 INFO [Listener at localhost/36111] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-23 10:06:07,694 DEBUG [Listener at localhost/36111] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-23 10:06:07,696 INFO [Listener at localhost/36111] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 10:06:07,699 INFO [Listener at localhost/36111] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 10:06:07,701 INFO [Listener at localhost/36111] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43301 connecting to ZooKeeper ensemble=127.0.0.1:61286 2023-07-23 10:06:07,722 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:433010x0, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 10:06:07,723 DEBUG [Listener at localhost/36111] zookeeper.ZKUtil(164): regionserver:433010x0, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 10:06:07,727 DEBUG [Listener at localhost/36111] zookeeper.ZKUtil(164): regionserver:433010x0, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 10:06:07,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43301-0x10191a5228d0001 connected 2023-07-23 10:06:07,728 DEBUG [Listener at localhost/36111] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 10:06:07,738 DEBUG [Listener at localhost/36111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43301 2023-07-23 10:06:07,739 DEBUG [Listener at localhost/36111] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43301 2023-07-23 10:06:07,740 DEBUG [Listener at localhost/36111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43301 2023-07-23 10:06:07,741 DEBUG [Listener at localhost/36111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43301 2023-07-23 10:06:07,742 DEBUG [Listener at localhost/36111] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43301 2023-07-23 10:06:07,756 INFO [Listener at localhost/36111] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 10:06:07,756 INFO [Listener at localhost/36111] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,756 INFO [Listener at localhost/36111] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,757 INFO [Listener at localhost/36111] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 10:06:07,757 INFO [Listener at localhost/36111] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,757 INFO [Listener at localhost/36111] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 10:06:07,758 INFO [Listener at localhost/36111] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 10:06:07,764 INFO [Listener at localhost/36111] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44315 2023-07-23 10:06:07,764 INFO [Listener at localhost/36111] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-23 10:06:07,766 DEBUG [Listener at localhost/36111] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-23 10:06:07,767 INFO [Listener at localhost/36111] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 10:06:07,770 INFO [Listener at localhost/36111] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 10:06:07,773 INFO [Listener at localhost/36111] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44315 connecting to ZooKeeper ensemble=127.0.0.1:61286 2023-07-23 10:06:07,777 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:443150x0, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 10:06:07,778 DEBUG [Listener at localhost/36111] zookeeper.ZKUtil(164): regionserver:443150x0, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 10:06:07,779 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44315-0x10191a5228d0002 connected 2023-07-23 10:06:07,779 DEBUG [Listener at localhost/36111] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 10:06:07,780 DEBUG [Listener at localhost/36111] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 10:06:07,782 DEBUG [Listener at localhost/36111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44315 2023-07-23 10:06:07,786 DEBUG [Listener at localhost/36111] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44315 2023-07-23 10:06:07,787 DEBUG [Listener at localhost/36111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44315 2023-07-23 10:06:07,795 DEBUG [Listener at localhost/36111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44315 2023-07-23 10:06:07,798 DEBUG [Listener at localhost/36111] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44315 2023-07-23 10:06:07,813 INFO [Listener at localhost/36111] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 10:06:07,813 INFO [Listener at localhost/36111] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,813 INFO [Listener at localhost/36111] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,814 INFO [Listener at localhost/36111] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 10:06:07,814 INFO [Listener at localhost/36111] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,814 INFO [Listener at localhost/36111] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 10:06:07,814 INFO [Listener at localhost/36111] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 10:06:07,816 INFO [Listener at localhost/36111] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35943 2023-07-23 10:06:07,817 INFO [Listener at localhost/36111] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-23 10:06:07,819 DEBUG [Listener at localhost/36111] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-23 10:06:07,820 INFO [Listener at localhost/36111] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 10:06:07,823 INFO [Listener at localhost/36111] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 10:06:07,825 INFO [Listener at localhost/36111] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35943 connecting to ZooKeeper ensemble=127.0.0.1:61286 2023-07-23 10:06:07,829 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:359430x0, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 10:06:07,830 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35943-0x10191a5228d0003 connected 2023-07-23 10:06:07,831 DEBUG [Listener at localhost/36111] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 10:06:07,831 DEBUG [Listener at localhost/36111] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 10:06:07,832 DEBUG [Listener at localhost/36111] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 10:06:07,837 DEBUG [Listener at localhost/36111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35943 2023-07-23 10:06:07,837 DEBUG [Listener at localhost/36111] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35943 2023-07-23 10:06:07,838 DEBUG [Listener at localhost/36111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35943 2023-07-23 10:06:07,842 DEBUG [Listener at localhost/36111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35943 2023-07-23 10:06:07,842 DEBUG [Listener at localhost/36111] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35943 2023-07-23 10:06:07,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39043,1690106766136 2023-07-23 10:06:07,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39043,1690106766136 2023-07-23 10:06:07,857 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-23 10:06:07,883 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 10:06:07,884 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 10:06:07,883 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 10:06:07,885 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 10:06:07,885 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 10:06:07,897 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-23 10:06:07,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-23 10:06:07,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39043,1690106766136 from backup master directory 2023-07-23 10:06:07,907 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39043,1690106766136 2023-07-23 10:06:07,907 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-23 10:06:07,908 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 10:06:07,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39043,1690106766136 2023-07-23 10:06:07,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-23 10:06:07,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-23 10:06:08,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/hbase.id with ID: abae07bd-d304-42fa-933c-a4e4742bdfc9 2023-07-23 10:06:08,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 10:06:08,087 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 10:06:08,155 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7eb6cbfc to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:08,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31b7a2ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:08,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 10:06:08,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-23 10:06:08,253 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-23 10:06:08,253 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-23 10:06:08,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-23 10:06:08,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-23 10:06:08,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 10:06:08,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/MasterData/data/master/store-tmp 2023-07-23 10:06:08,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:08,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-23 10:06:08,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 10:06:08,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 10:06:08,367 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-23 10:06:08,367 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 10:06:08,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 10:06:08,367 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-23 10:06:08,369 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/MasterData/WALs/jenkins-hbase4.apache.org,39043,1690106766136 2023-07-23 10:06:08,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39043%2C1690106766136, suffix=, logDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/MasterData/WALs/jenkins-hbase4.apache.org,39043,1690106766136, archiveDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/MasterData/oldWALs, maxLogs=10 2023-07-23 10:06:08,479 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33687,DS-1bf4399c-dcd7-4c07-b54c-131f66a28c53,DISK] 2023-07-23 10:06:08,479 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39101,DS-d8033750-5b73-4439-94a7-9d34cfbdd874,DISK] 2023-07-23 10:06:08,479 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37725,DS-e387ecee-d624-4f11-8e10-bc0f88b0faf1,DISK] 2023-07-23 10:06:08,492 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-23 10:06:08,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/MasterData/WALs/jenkins-hbase4.apache.org,39043,1690106766136/jenkins-hbase4.apache.org%2C39043%2C1690106766136.1690106768405 2023-07-23 10:06:08,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39101,DS-d8033750-5b73-4439-94a7-9d34cfbdd874,DISK], DatanodeInfoWithStorage[127.0.0.1:37725,DS-e387ecee-d624-4f11-8e10-bc0f88b0faf1,DISK], DatanodeInfoWithStorage[127.0.0.1:33687,DS-1bf4399c-dcd7-4c07-b54c-131f66a28c53,DISK]] 2023-07-23 10:06:08,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-23 10:06:08,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:08,608 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-23 10:06:08,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-23 10:06:08,701 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-23 10:06:08,710 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-23 10:06:08,750 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-23 10:06:08,763 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:08,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-23 10:06:08,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-23 10:06:08,815 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-23 10:06:08,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:06:08,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65966469, jitterRate=-0.017023012042045593}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:06:08,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-23 10:06:08,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-23 10:06:08,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-23 10:06:08,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-23 10:06:08,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-23 10:06:08,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-23 10:06:08,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 44 msec 2023-07-23 10:06:08,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-23 10:06:08,946 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-23 10:06:08,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-23 10:06:08,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-23 10:06:08,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-23 10:06:08,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-23 10:06:08,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-23 10:06:08,998 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-23 10:06:09,001 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 10:06:09,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-23 10:06:09,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-23 10:06:09,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-23 10:06:09,026 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 10:06:09,026 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 10:06:09,026 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 10:06:09,026 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 10:06:09,026 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 10:06:09,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,39043,1690106766136, sessionid=0x10191a5228d0000, setting cluster-up flag (Was=false) 2023-07-23 10:06:09,049 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 10:06:09,057 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-23 10:06:09,059 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39043,1690106766136 2023-07-23 10:06:09,066 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 10:06:09,072 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-23 10:06:09,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39043,1690106766136 2023-07-23 10:06:09,079 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp 2023-07-23 10:06:09,149 INFO [RS:0;jenkins-hbase4:43301] regionserver.HRegionServer(951): ClusterId : abae07bd-d304-42fa-933c-a4e4742bdfc9 2023-07-23 10:06:09,160 INFO [RS:2;jenkins-hbase4:35943] regionserver.HRegionServer(951): ClusterId : abae07bd-d304-42fa-933c-a4e4742bdfc9 2023-07-23 10:06:09,161 DEBUG [RS:0;jenkins-hbase4:43301] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-23 10:06:09,160 INFO [RS:1;jenkins-hbase4:44315] regionserver.HRegionServer(951): ClusterId : abae07bd-d304-42fa-933c-a4e4742bdfc9 2023-07-23 10:06:09,171 DEBUG [RS:2;jenkins-hbase4:35943] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-23 10:06:09,171 DEBUG [RS:1;jenkins-hbase4:44315] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-23 10:06:09,194 DEBUG [RS:0;jenkins-hbase4:43301] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-23 10:06:09,194 DEBUG [RS:0;jenkins-hbase4:43301] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-23 10:06:09,194 DEBUG [RS:2;jenkins-hbase4:35943] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-23 10:06:09,194 DEBUG [RS:2;jenkins-hbase4:35943] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-23 10:06:09,198 DEBUG [RS:0;jenkins-hbase4:43301] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-23 10:06:09,198 DEBUG [RS:2;jenkins-hbase4:35943] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-23 10:06:09,200 DEBUG [RS:1;jenkins-hbase4:44315] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-23 10:06:09,203 DEBUG [RS:1;jenkins-hbase4:44315] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-23 10:06:09,203 DEBUG [RS:0;jenkins-hbase4:43301] zookeeper.ReadOnlyZKClient(139): Connect 0x5a1a8aed to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:09,203 DEBUG [RS:2;jenkins-hbase4:35943] zookeeper.ReadOnlyZKClient(139): Connect 0x10907810 to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:09,207 DEBUG [RS:1;jenkins-hbase4:44315] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-23 10:06:09,234 DEBUG [RS:1;jenkins-hbase4:44315] zookeeper.ReadOnlyZKClient(139): Connect 0x3054ce79 to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:09,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-23 10:06:09,275 DEBUG [RS:0;jenkins-hbase4:43301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a8a99ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:09,276 DEBUG [RS:0;jenkins-hbase4:43301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23d59528, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 10:06:09,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:09,281 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-23 10:06:09,287 DEBUG [RS:2;jenkins-hbase4:35943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e579472, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:09,287 DEBUG [RS:1;jenkins-hbase4:44315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e933603, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:09,288 DEBUG [RS:2;jenkins-hbase4:35943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a681360, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 10:06:09,291 DEBUG [RS:1;jenkins-hbase4:44315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fae3c38, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 10:06:09,318 DEBUG [RS:0;jenkins-hbase4:43301] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43301 2023-07-23 10:06:09,326 INFO [RS:0;jenkins-hbase4:43301] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-23 10:06:09,326 INFO [RS:0;jenkins-hbase4:43301] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-23 10:06:09,322 DEBUG [RS:1;jenkins-hbase4:44315] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44315 2023-07-23 10:06:09,326 INFO [RS:1;jenkins-hbase4:44315] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-23 10:06:09,329 INFO [RS:1;jenkins-hbase4:44315] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-23 10:06:09,329 DEBUG [RS:1;jenkins-hbase4:44315] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-23 10:06:09,331 DEBUG [RS:2;jenkins-hbase4:35943] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:35943 2023-07-23 10:06:09,331 INFO [RS:2;jenkins-hbase4:35943] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-23 10:06:09,331 INFO [RS:2;jenkins-hbase4:35943] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-23 10:06:09,331 DEBUG [RS:2;jenkins-hbase4:35943] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-23 10:06:09,331 DEBUG [RS:0;jenkins-hbase4:43301] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-23 10:06:09,338 INFO [RS:1;jenkins-hbase4:44315] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:09,338 DEBUG [RS:1;jenkins-hbase4:44315] regionserver.HRegionServer(1022): About to register with Master. 2023-07-23 10:06:09,332 INFO [RS:2;jenkins-hbase4:35943] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:09,338 DEBUG [RS:2;jenkins-hbase4:35943] regionserver.HRegionServer(1022): About to register with Master. 2023-07-23 10:06:09,332 INFO [RS:0;jenkins-hbase4:43301] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:09,339 DEBUG [RS:0;jenkins-hbase4:43301] regionserver.HRegionServer(1022): About to register with Master. 2023-07-23 10:06:09,342 INFO [RS:0;jenkins-hbase4:43301] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39043,1690106766136 with isa=jenkins-hbase4.apache.org/172.31.14.131:43301, startcode=1690106767667 2023-07-23 10:06:09,342 INFO [RS:2;jenkins-hbase4:35943] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39043,1690106766136 with isa=jenkins-hbase4.apache.org/172.31.14.131:35943, startcode=1690106767812 2023-07-23 10:06:09,342 INFO [RS:1;jenkins-hbase4:44315] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39043,1690106766136 with isa=jenkins-hbase4.apache.org/172.31.14.131:44315, startcode=1690106767755 2023-07-23 10:06:09,365 DEBUG [RS:0;jenkins-hbase4:43301] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-23 10:06:09,365 DEBUG [RS:1;jenkins-hbase4:44315] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-23 10:06:09,366 DEBUG [RS:2;jenkins-hbase4:35943] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-23 10:06:09,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-23 10:06:09,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 10:06:09,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 10:06:09,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 10:06:09,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 10:06:09,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-23 10:06:09,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 10:06:09,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,481 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690106799481 2023-07-23 10:06:09,482 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56551, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-23 10:06:09,482 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43821, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-23 10:06:09,482 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38803, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-23 10:06:09,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-23 10:06:09,490 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-23 10:06:09,491 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-23 10:06:09,496 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39043] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-23 10:06:09,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-23 10:06:09,503 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-23 10:06:09,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-23 10:06:09,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-23 10:06:09,511 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39043] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-23 10:06:09,511 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-23 10:06:09,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-23 10:06:09,512 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39043] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-23 10:06:09,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,517 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-23 10:06:09,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-23 10:06:09,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-23 10:06:09,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-23 10:06:09,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-23 10:06:09,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690106769525,5,FailOnTimeoutGroup] 2023-07-23 10:06:09,538 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690106769531,5,FailOnTimeoutGroup] 2023-07-23 10:06:09,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-23 10:06:09,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,556 DEBUG [RS:1;jenkins-hbase4:44315] regionserver.HRegionServer(2830): Master is not running yet 2023-07-23 10:06:09,557 WARN [RS:1;jenkins-hbase4:44315] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-23 10:06:09,557 DEBUG [RS:2;jenkins-hbase4:35943] regionserver.HRegionServer(2830): Master is not running yet 2023-07-23 10:06:09,557 WARN [RS:2;jenkins-hbase4:35943] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-23 10:06:09,557 DEBUG [RS:0;jenkins-hbase4:43301] regionserver.HRegionServer(2830): Master is not running yet 2023-07-23 10:06:09,557 WARN [RS:0;jenkins-hbase4:43301] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-23 10:06:09,586 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-23 10:06:09,588 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-23 10:06:09,588 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa 2023-07-23 10:06:09,658 INFO [RS:0;jenkins-hbase4:43301] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39043,1690106766136 with isa=jenkins-hbase4.apache.org/172.31.14.131:43301, startcode=1690106767667 2023-07-23 10:06:09,658 INFO [RS:1;jenkins-hbase4:44315] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39043,1690106766136 with isa=jenkins-hbase4.apache.org/172.31.14.131:44315, startcode=1690106767755 2023-07-23 10:06:09,658 INFO [RS:2;jenkins-hbase4:35943] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39043,1690106766136 with isa=jenkins-hbase4.apache.org/172.31.14.131:35943, startcode=1690106767812 2023-07-23 10:06:09,667 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39043] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:09,674 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39043] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:09,675 DEBUG [RS:0;jenkins-hbase4:43301] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa 2023-07-23 10:06:09,675 DEBUG [RS:0;jenkins-hbase4:43301] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39321 2023-07-23 10:06:09,675 DEBUG [RS:0;jenkins-hbase4:43301] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-23 10:06:09,681 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39043] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:09,682 DEBUG [RS:2;jenkins-hbase4:35943] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa 2023-07-23 10:06:09,682 DEBUG [RS:2;jenkins-hbase4:35943] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39321 2023-07-23 10:06:09,683 DEBUG [RS:2;jenkins-hbase4:35943] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-23 10:06:09,683 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 10:06:09,684 DEBUG [RS:0;jenkins-hbase4:43301] zookeeper.ZKUtil(162): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:09,684 WARN [RS:0;jenkins-hbase4:43301] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 10:06:09,684 INFO [RS:0;jenkins-hbase4:43301] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 10:06:09,684 DEBUG [RS:0;jenkins-hbase4:43301] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/WALs/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:09,685 DEBUG [RS:1;jenkins-hbase4:44315] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa 2023-07-23 10:06:09,685 DEBUG [RS:1;jenkins-hbase4:44315] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39321 2023-07-23 10:06:09,685 DEBUG [RS:1;jenkins-hbase4:44315] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-23 10:06:09,689 DEBUG [RS:2;jenkins-hbase4:35943] zookeeper.ZKUtil(162): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:09,689 WARN [RS:2;jenkins-hbase4:35943] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 10:06:09,690 INFO [RS:2;jenkins-hbase4:35943] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 10:06:09,690 DEBUG [RS:2;jenkins-hbase4:35943] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/WALs/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:09,691 DEBUG [RS:1;jenkins-hbase4:44315] zookeeper.ZKUtil(162): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:09,691 WARN [RS:1;jenkins-hbase4:44315] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 10:06:09,691 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44315,1690106767755] 2023-07-23 10:06:09,691 INFO [RS:1;jenkins-hbase4:44315] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 10:06:09,691 DEBUG [RS:1;jenkins-hbase4:44315] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/WALs/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:09,691 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35943,1690106767812] 2023-07-23 10:06:09,692 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43301,1690106767667] 2023-07-23 10:06:09,703 DEBUG [RS:0;jenkins-hbase4:43301] zookeeper.ZKUtil(162): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:09,703 DEBUG [RS:2;jenkins-hbase4:35943] zookeeper.ZKUtil(162): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:09,704 DEBUG [RS:0;jenkins-hbase4:43301] zookeeper.ZKUtil(162): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:09,706 DEBUG [RS:0;jenkins-hbase4:43301] zookeeper.ZKUtil(162): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:09,709 DEBUG [RS:2;jenkins-hbase4:35943] zookeeper.ZKUtil(162): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:09,710 DEBUG [RS:1;jenkins-hbase4:44315] zookeeper.ZKUtil(162): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:09,710 DEBUG [RS:2;jenkins-hbase4:35943] zookeeper.ZKUtil(162): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:09,711 DEBUG [RS:1;jenkins-hbase4:44315] zookeeper.ZKUtil(162): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:09,711 DEBUG [RS:1;jenkins-hbase4:44315] zookeeper.ZKUtil(162): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:09,722 DEBUG [RS:1;jenkins-hbase4:44315] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-23 10:06:09,722 DEBUG [RS:2;jenkins-hbase4:35943] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-23 10:06:09,722 DEBUG [RS:0;jenkins-hbase4:43301] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-23 10:06:09,737 INFO [RS:1;jenkins-hbase4:44315] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-23 10:06:09,737 INFO [RS:2;jenkins-hbase4:35943] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-23 10:06:09,741 INFO [RS:0;jenkins-hbase4:43301] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-23 10:06:09,768 INFO [RS:0;jenkins-hbase4:43301] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-23 10:06:09,770 INFO [RS:2;jenkins-hbase4:35943] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-23 10:06:09,768 INFO [RS:1;jenkins-hbase4:44315] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-23 10:06:09,773 INFO [RS:0;jenkins-hbase4:43301] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-23 10:06:09,773 INFO [RS:0;jenkins-hbase4:43301] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,776 INFO [RS:2;jenkins-hbase4:35943] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-23 10:06:09,783 INFO [RS:2;jenkins-hbase4:35943] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,783 INFO [RS:0;jenkins-hbase4:43301] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-23 10:06:09,779 INFO [RS:1;jenkins-hbase4:44315] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-23 10:06:09,783 INFO [RS:2;jenkins-hbase4:35943] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-23 10:06:09,784 INFO [RS:1;jenkins-hbase4:44315] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,786 INFO [RS:1;jenkins-hbase4:44315] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-23 10:06:09,797 INFO [RS:1;jenkins-hbase4:44315] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,797 INFO [RS:0;jenkins-hbase4:43301] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,797 INFO [RS:2;jenkins-hbase4:35943] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,797 DEBUG [RS:1;jenkins-hbase4:44315] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,798 DEBUG [RS:1;jenkins-hbase4:44315] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,798 DEBUG [RS:1;jenkins-hbase4:44315] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,797 DEBUG [RS:0;jenkins-hbase4:43301] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,799 DEBUG [RS:2;jenkins-hbase4:35943] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,799 DEBUG [RS:2;jenkins-hbase4:35943] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,799 DEBUG [RS:1;jenkins-hbase4:44315] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,799 DEBUG [RS:2;jenkins-hbase4:35943] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,799 DEBUG [RS:1;jenkins-hbase4:44315] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,799 DEBUG [RS:2;jenkins-hbase4:35943] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,799 DEBUG [RS:1;jenkins-hbase4:44315] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 10:06:09,799 DEBUG [RS:2;jenkins-hbase4:35943] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,799 DEBUG [RS:1;jenkins-hbase4:44315] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,800 DEBUG [RS:2;jenkins-hbase4:35943] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 10:06:09,800 DEBUG [RS:1;jenkins-hbase4:44315] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,800 DEBUG [RS:2;jenkins-hbase4:35943] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,800 DEBUG [RS:1;jenkins-hbase4:44315] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,800 DEBUG [RS:2;jenkins-hbase4:35943] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,800 DEBUG [RS:1;jenkins-hbase4:44315] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,800 DEBUG [RS:2;jenkins-hbase4:35943] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,800 DEBUG [RS:2;jenkins-hbase4:35943] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,800 DEBUG [RS:0;jenkins-hbase4:43301] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,800 DEBUG [RS:0;jenkins-hbase4:43301] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,801 DEBUG [RS:0;jenkins-hbase4:43301] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,801 DEBUG [RS:0;jenkins-hbase4:43301] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,801 DEBUG [RS:0;jenkins-hbase4:43301] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 10:06:09,801 DEBUG [RS:0;jenkins-hbase4:43301] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,801 DEBUG [RS:0;jenkins-hbase4:43301] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,801 DEBUG [RS:0;jenkins-hbase4:43301] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,801 DEBUG [RS:0;jenkins-hbase4:43301] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,814 INFO [RS:2;jenkins-hbase4:35943] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,814 INFO [RS:2;jenkins-hbase4:35943] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,814 INFO [RS:2;jenkins-hbase4:35943] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,822 INFO [RS:0;jenkins-hbase4:43301] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,822 INFO [RS:0;jenkins-hbase4:43301] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,822 INFO [RS:0;jenkins-hbase4:43301] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,826 INFO [RS:1;jenkins-hbase4:44315] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,827 INFO [RS:1;jenkins-hbase4:44315] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,827 INFO [RS:1;jenkins-hbase4:44315] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,858 INFO [RS:0;jenkins-hbase4:43301] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-23 10:06:09,858 INFO [RS:2;jenkins-hbase4:35943] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-23 10:06:09,862 INFO [RS:1;jenkins-hbase4:44315] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-23 10:06:09,862 INFO [RS:2;jenkins-hbase4:35943] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35943,1690106767812-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,862 INFO [RS:0;jenkins-hbase4:43301] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43301,1690106767667-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,871 INFO [RS:1;jenkins-hbase4:44315] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44315,1690106767755-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,901 INFO [RS:2;jenkins-hbase4:35943] regionserver.Replication(203): jenkins-hbase4.apache.org,35943,1690106767812 started 2023-07-23 10:06:09,901 INFO [RS:2;jenkins-hbase4:35943] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35943,1690106767812, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35943, sessionid=0x10191a5228d0003 2023-07-23 10:06:09,901 DEBUG [RS:2;jenkins-hbase4:35943] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-23 10:06:09,902 DEBUG [RS:2;jenkins-hbase4:35943] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:09,902 DEBUG [RS:2;jenkins-hbase4:35943] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35943,1690106767812' 2023-07-23 10:06:09,902 DEBUG [RS:2;jenkins-hbase4:35943] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-23 10:06:09,902 INFO [RS:1;jenkins-hbase4:44315] regionserver.Replication(203): jenkins-hbase4.apache.org,44315,1690106767755 started 2023-07-23 10:06:09,902 INFO [RS:1;jenkins-hbase4:44315] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44315,1690106767755, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44315, sessionid=0x10191a5228d0002 2023-07-23 10:06:09,902 INFO [RS:0;jenkins-hbase4:43301] regionserver.Replication(203): jenkins-hbase4.apache.org,43301,1690106767667 started 2023-07-23 10:06:09,902 INFO [RS:0;jenkins-hbase4:43301] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43301,1690106767667, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43301, sessionid=0x10191a5228d0001 2023-07-23 10:06:09,903 DEBUG [RS:1;jenkins-hbase4:44315] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-23 10:06:09,903 DEBUG [RS:2;jenkins-hbase4:35943] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-23 10:06:09,903 DEBUG [RS:0;jenkins-hbase4:43301] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-23 10:06:09,903 DEBUG [RS:0;jenkins-hbase4:43301] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:09,903 DEBUG [RS:1;jenkins-hbase4:44315] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:09,904 DEBUG [RS:1;jenkins-hbase4:44315] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44315,1690106767755' 2023-07-23 10:06:09,904 DEBUG [RS:1;jenkins-hbase4:44315] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-23 10:06:09,904 DEBUG [RS:0;jenkins-hbase4:43301] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43301,1690106767667' 2023-07-23 10:06:09,904 DEBUG [RS:0;jenkins-hbase4:43301] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-23 10:06:09,905 DEBUG [RS:2;jenkins-hbase4:35943] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-23 10:06:09,905 DEBUG [RS:1;jenkins-hbase4:44315] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-23 10:06:09,905 DEBUG [RS:2;jenkins-hbase4:35943] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-23 10:06:09,906 DEBUG [RS:2;jenkins-hbase4:35943] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:09,906 DEBUG [RS:2;jenkins-hbase4:35943] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35943,1690106767812' 2023-07-23 10:06:09,906 DEBUG [RS:2;jenkins-hbase4:35943] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:09,906 DEBUG [RS:0;jenkins-hbase4:43301] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-23 10:06:09,906 DEBUG [RS:1;jenkins-hbase4:44315] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-23 10:06:09,906 DEBUG [RS:2;jenkins-hbase4:35943] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:09,906 DEBUG [RS:1;jenkins-hbase4:44315] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-23 10:06:09,907 DEBUG [RS:0;jenkins-hbase4:43301] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-23 10:06:09,907 DEBUG [RS:0;jenkins-hbase4:43301] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-23 10:06:09,907 DEBUG [RS:0;jenkins-hbase4:43301] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:09,907 DEBUG [RS:0;jenkins-hbase4:43301] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43301,1690106767667' 2023-07-23 10:06:09,908 DEBUG [RS:0;jenkins-hbase4:43301] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:09,907 DEBUG [RS:1;jenkins-hbase4:44315] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:09,908 DEBUG [RS:1;jenkins-hbase4:44315] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44315,1690106767755' 2023-07-23 10:06:09,908 DEBUG [RS:1;jenkins-hbase4:44315] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:09,908 DEBUG [RS:2;jenkins-hbase4:35943] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-23 10:06:09,908 INFO [RS:2;jenkins-hbase4:35943] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-23 10:06:09,908 DEBUG [RS:0;jenkins-hbase4:43301] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:09,908 INFO [RS:2;jenkins-hbase4:35943] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-23 10:06:09,909 DEBUG [RS:1;jenkins-hbase4:44315] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:09,909 DEBUG [RS:0;jenkins-hbase4:43301] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-23 10:06:09,909 INFO [RS:0;jenkins-hbase4:43301] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-23 10:06:09,909 INFO [RS:0;jenkins-hbase4:43301] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-23 10:06:09,910 DEBUG [RS:1;jenkins-hbase4:44315] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-23 10:06:09,910 INFO [RS:1;jenkins-hbase4:44315] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-23 10:06:09,910 INFO [RS:1;jenkins-hbase4:44315] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-23 10:06:10,024 INFO [RS:1;jenkins-hbase4:44315] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44315%2C1690106767755, suffix=, logDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/WALs/jenkins-hbase4.apache.org,44315,1690106767755, archiveDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/oldWALs, maxLogs=32 2023-07-23 10:06:10,025 INFO [RS:0;jenkins-hbase4:43301] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43301%2C1690106767667, suffix=, logDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/WALs/jenkins-hbase4.apache.org,43301,1690106767667, archiveDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/oldWALs, maxLogs=32 2023-07-23 10:06:10,029 INFO [RS:2;jenkins-hbase4:35943] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35943%2C1690106767812, suffix=, logDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/WALs/jenkins-hbase4.apache.org,35943,1690106767812, archiveDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/oldWALs, maxLogs=32 2023-07-23 10:06:10,032 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:10,045 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-23 10:06:10,049 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740/info 2023-07-23 10:06:10,050 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-23 10:06:10,051 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:10,051 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-23 10:06:10,054 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740/rep_barrier 2023-07-23 10:06:10,056 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-23 10:06:10,057 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:10,057 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-23 10:06:10,073 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33687,DS-1bf4399c-dcd7-4c07-b54c-131f66a28c53,DISK] 2023-07-23 10:06:10,074 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39101,DS-d8033750-5b73-4439-94a7-9d34cfbdd874,DISK] 2023-07-23 10:06:10,076 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37725,DS-e387ecee-d624-4f11-8e10-bc0f88b0faf1,DISK] 2023-07-23 10:06:10,079 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39101,DS-d8033750-5b73-4439-94a7-9d34cfbdd874,DISK] 2023-07-23 10:06:10,079 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740/table 2023-07-23 10:06:10,080 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-23 10:06:10,080 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37725,DS-e387ecee-d624-4f11-8e10-bc0f88b0faf1,DISK] 2023-07-23 10:06:10,080 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33687,DS-1bf4399c-dcd7-4c07-b54c-131f66a28c53,DISK] 2023-07-23 10:06:10,095 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39101,DS-d8033750-5b73-4439-94a7-9d34cfbdd874,DISK] 2023-07-23 10:06:10,096 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37725,DS-e387ecee-d624-4f11-8e10-bc0f88b0faf1,DISK] 2023-07-23 10:06:10,082 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:10,099 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33687,DS-1bf4399c-dcd7-4c07-b54c-131f66a28c53,DISK] 2023-07-23 10:06:10,122 INFO [RS:2;jenkins-hbase4:35943] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/WALs/jenkins-hbase4.apache.org,35943,1690106767812/jenkins-hbase4.apache.org%2C35943%2C1690106767812.1690106770031 2023-07-23 10:06:10,122 INFO [RS:1;jenkins-hbase4:44315] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/WALs/jenkins-hbase4.apache.org,44315,1690106767755/jenkins-hbase4.apache.org%2C44315%2C1690106767755.1690106770031 2023-07-23 10:06:10,123 DEBUG [RS:2;jenkins-hbase4:35943] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37725,DS-e387ecee-d624-4f11-8e10-bc0f88b0faf1,DISK], DatanodeInfoWithStorage[127.0.0.1:39101,DS-d8033750-5b73-4439-94a7-9d34cfbdd874,DISK], DatanodeInfoWithStorage[127.0.0.1:33687,DS-1bf4399c-dcd7-4c07-b54c-131f66a28c53,DISK]] 2023-07-23 10:06:10,127 DEBUG [RS:1;jenkins-hbase4:44315] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39101,DS-d8033750-5b73-4439-94a7-9d34cfbdd874,DISK], DatanodeInfoWithStorage[127.0.0.1:33687,DS-1bf4399c-dcd7-4c07-b54c-131f66a28c53,DISK], DatanodeInfoWithStorage[127.0.0.1:37725,DS-e387ecee-d624-4f11-8e10-bc0f88b0faf1,DISK]] 2023-07-23 10:06:10,130 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740 2023-07-23 10:06:10,131 INFO [RS:0;jenkins-hbase4:43301] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/WALs/jenkins-hbase4.apache.org,43301,1690106767667/jenkins-hbase4.apache.org%2C43301%2C1690106767667.1690106770031 2023-07-23 10:06:10,135 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740 2023-07-23 10:06:10,139 DEBUG [RS:0;jenkins-hbase4:43301] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37725,DS-e387ecee-d624-4f11-8e10-bc0f88b0faf1,DISK], DatanodeInfoWithStorage[127.0.0.1:39101,DS-d8033750-5b73-4439-94a7-9d34cfbdd874,DISK], DatanodeInfoWithStorage[127.0.0.1:33687,DS-1bf4399c-dcd7-4c07-b54c-131f66a28c53,DISK]] 2023-07-23 10:06:10,144 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-23 10:06:10,146 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-23 10:06:10,155 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:06:10,156 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60420417, jitterRate=-0.09966562688350677}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-23 10:06:10,156 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-23 10:06:10,156 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-23 10:06:10,156 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-23 10:06:10,156 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-23 10:06:10,156 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-23 10:06:10,156 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-23 10:06:10,163 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-23 10:06:10,167 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-23 10:06:10,174 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-23 10:06:10,174 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-23 10:06:10,186 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-23 10:06:10,203 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-23 10:06:10,209 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-23 10:06:10,361 DEBUG [jenkins-hbase4:39043] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-23 10:06:10,365 DEBUG [jenkins-hbase4:39043] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 10:06:10,371 DEBUG [jenkins-hbase4:39043] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 10:06:10,371 DEBUG [jenkins-hbase4:39043] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 10:06:10,371 DEBUG [jenkins-hbase4:39043] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 10:06:10,371 DEBUG [jenkins-hbase4:39043] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 10:06:10,374 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44315,1690106767755, state=OPENING 2023-07-23 10:06:10,385 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-23 10:06:10,387 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 10:06:10,387 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-23 10:06:10,390 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44315,1690106767755}] 2023-07-23 10:06:10,588 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:10,594 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 10:06:10,600 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 10:06:10,616 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-23 10:06:10,617 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 10:06:10,621 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44315%2C1690106767755.meta, suffix=.meta, logDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/WALs/jenkins-hbase4.apache.org,44315,1690106767755, archiveDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/oldWALs, maxLogs=32 2023-07-23 10:06:10,643 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37725,DS-e387ecee-d624-4f11-8e10-bc0f88b0faf1,DISK] 2023-07-23 10:06:10,643 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39101,DS-d8033750-5b73-4439-94a7-9d34cfbdd874,DISK] 2023-07-23 10:06:10,643 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33687,DS-1bf4399c-dcd7-4c07-b54c-131f66a28c53,DISK] 2023-07-23 10:06:10,651 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/WALs/jenkins-hbase4.apache.org,44315,1690106767755/jenkins-hbase4.apache.org%2C44315%2C1690106767755.meta.1690106770622.meta 2023-07-23 10:06:10,653 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37725,DS-e387ecee-d624-4f11-8e10-bc0f88b0faf1,DISK], DatanodeInfoWithStorage[127.0.0.1:39101,DS-d8033750-5b73-4439-94a7-9d34cfbdd874,DISK], DatanodeInfoWithStorage[127.0.0.1:33687,DS-1bf4399c-dcd7-4c07-b54c-131f66a28c53,DISK]] 2023-07-23 10:06:10,653 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-23 10:06:10,655 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-23 10:06:10,656 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:10,657 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-23 10:06:10,659 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-23 10:06:10,660 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-23 10:06:10,673 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-23 10:06:10,673 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:10,673 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-23 10:06:10,674 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-23 10:06:10,676 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-23 10:06:10,678 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740/info 2023-07-23 10:06:10,678 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740/info 2023-07-23 10:06:10,679 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-23 10:06:10,680 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:10,680 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-23 10:06:10,682 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740/rep_barrier 2023-07-23 10:06:10,682 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740/rep_barrier 2023-07-23 10:06:10,683 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-23 10:06:10,683 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:10,684 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-23 10:06:10,685 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740/table 2023-07-23 10:06:10,685 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740/table 2023-07-23 10:06:10,686 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-23 10:06:10,687 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:10,690 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740 2023-07-23 10:06:10,696 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740 2023-07-23 10:06:10,701 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-23 10:06:10,704 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-23 10:06:10,705 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74917554, jitterRate=0.11635854840278625}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-23 10:06:10,708 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-23 10:06:10,718 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690106770575 2023-07-23 10:06:10,737 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-23 10:06:10,738 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-23 10:06:10,738 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44315,1690106767755, state=OPEN 2023-07-23 10:06:10,742 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-23 10:06:10,742 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-23 10:06:10,747 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-23 10:06:10,747 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44315,1690106767755 in 352 msec 2023-07-23 10:06:10,753 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-23 10:06:10,753 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 562 msec 2023-07-23 10:06:10,758 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.4580 sec 2023-07-23 10:06:10,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690106770759, completionTime=-1 2023-07-23 10:06:10,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-23 10:06:10,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-23 10:06:10,833 DEBUG [hconnection-0x5a736194-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:10,836 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:10,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-23 10:06:10,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690106830858 2023-07-23 10:06:10,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690106890858 2023-07-23 10:06:10,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 99 msec 2023-07-23 10:06:10,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39043,1690106766136-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:10,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39043,1690106766136-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:10,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39043,1690106766136-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:10,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39043, period=300000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:10,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:10,898 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-23 10:06:10,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-23 10:06:10,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-23 10:06:10,922 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-23 10:06:10,925 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 10:06:10,927 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 10:06:10,950 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/hbase/namespace/d3eb2f372d792f1e136075e91f7a577c 2023-07-23 10:06:10,953 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/hbase/namespace/d3eb2f372d792f1e136075e91f7a577c empty. 2023-07-23 10:06:10,954 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/hbase/namespace/d3eb2f372d792f1e136075e91f7a577c 2023-07-23 10:06:10,954 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-23 10:06:10,992 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-23 10:06:10,994 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => d3eb2f372d792f1e136075e91f7a577c, NAME => 'hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp 2023-07-23 10:06:11,017 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:11,018 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing d3eb2f372d792f1e136075e91f7a577c, disabling compactions & flushes 2023-07-23 10:06:11,018 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c. 2023-07-23 10:06:11,018 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c. 2023-07-23 10:06:11,018 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c. after waiting 0 ms 2023-07-23 10:06:11,018 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c. 2023-07-23 10:06:11,018 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c. 2023-07-23 10:06:11,018 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for d3eb2f372d792f1e136075e91f7a577c: 2023-07-23 10:06:11,024 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 10:06:11,039 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690106771027"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106771027"}]},"ts":"1690106771027"} 2023-07-23 10:06:11,074 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-23 10:06:11,076 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 10:06:11,080 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106771076"}]},"ts":"1690106771076"} 2023-07-23 10:06:11,087 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-23 10:06:11,092 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 10:06:11,094 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 10:06:11,094 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 10:06:11,094 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 10:06:11,094 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 10:06:11,097 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d3eb2f372d792f1e136075e91f7a577c, ASSIGN}] 2023-07-23 10:06:11,101 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d3eb2f372d792f1e136075e91f7a577c, ASSIGN 2023-07-23 10:06:11,103 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d3eb2f372d792f1e136075e91f7a577c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35943,1690106767812; forceNewPlan=false, retain=false 2023-07-23 10:06:11,257 INFO [jenkins-hbase4:39043] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-23 10:06:11,258 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d3eb2f372d792f1e136075e91f7a577c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:11,258 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690106771258"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106771258"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106771258"}]},"ts":"1690106771258"} 2023-07-23 10:06:11,262 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d3eb2f372d792f1e136075e91f7a577c, server=jenkins-hbase4.apache.org,35943,1690106767812}] 2023-07-23 10:06:11,417 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:11,418 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 10:06:11,421 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 10:06:11,427 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c. 2023-07-23 10:06:11,428 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d3eb2f372d792f1e136075e91f7a577c, NAME => 'hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c.', STARTKEY => '', ENDKEY => ''} 2023-07-23 10:06:11,428 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c. service=AccessControlService 2023-07-23 10:06:11,429 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:11,429 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d3eb2f372d792f1e136075e91f7a577c 2023-07-23 10:06:11,429 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:11,430 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d3eb2f372d792f1e136075e91f7a577c 2023-07-23 10:06:11,430 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d3eb2f372d792f1e136075e91f7a577c 2023-07-23 10:06:11,432 INFO [StoreOpener-d3eb2f372d792f1e136075e91f7a577c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d3eb2f372d792f1e136075e91f7a577c 2023-07-23 10:06:11,434 DEBUG [StoreOpener-d3eb2f372d792f1e136075e91f7a577c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/namespace/d3eb2f372d792f1e136075e91f7a577c/info 2023-07-23 10:06:11,434 DEBUG [StoreOpener-d3eb2f372d792f1e136075e91f7a577c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/namespace/d3eb2f372d792f1e136075e91f7a577c/info 2023-07-23 10:06:11,435 INFO [StoreOpener-d3eb2f372d792f1e136075e91f7a577c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d3eb2f372d792f1e136075e91f7a577c columnFamilyName info 2023-07-23 10:06:11,437 INFO [StoreOpener-d3eb2f372d792f1e136075e91f7a577c-1] regionserver.HStore(310): Store=d3eb2f372d792f1e136075e91f7a577c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:11,439 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/namespace/d3eb2f372d792f1e136075e91f7a577c 2023-07-23 10:06:11,440 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/namespace/d3eb2f372d792f1e136075e91f7a577c 2023-07-23 10:06:11,445 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d3eb2f372d792f1e136075e91f7a577c 2023-07-23 10:06:11,449 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/namespace/d3eb2f372d792f1e136075e91f7a577c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:06:11,450 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d3eb2f372d792f1e136075e91f7a577c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69927971, jitterRate=0.042007967829704285}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:06:11,450 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d3eb2f372d792f1e136075e91f7a577c: 2023-07-23 10:06:11,452 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c., pid=6, masterSystemTime=1690106771417 2023-07-23 10:06:11,457 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c. 2023-07-23 10:06:11,458 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c. 2023-07-23 10:06:11,460 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d3eb2f372d792f1e136075e91f7a577c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:11,460 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690106771459"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106771459"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106771459"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106771459"}]},"ts":"1690106771459"} 2023-07-23 10:06:11,468 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-23 10:06:11,469 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d3eb2f372d792f1e136075e91f7a577c, server=jenkins-hbase4.apache.org,35943,1690106767812 in 202 msec 2023-07-23 10:06:11,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-23 10:06:11,473 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d3eb2f372d792f1e136075e91f7a577c, ASSIGN in 373 msec 2023-07-23 10:06:11,474 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 10:06:11,475 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106771474"}]},"ts":"1690106771474"} 2023-07-23 10:06:11,477 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-23 10:06:11,482 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 10:06:11,486 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 571 msec 2023-07-23 10:06:11,526 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-23 10:06:11,529 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-23 10:06:11,529 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 10:06:11,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:11,557 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50612, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:11,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-23 10:06:11,608 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-23 10:06:11,618 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 52 msec 2023-07-23 10:06:11,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-23 10:06:11,646 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-23 10:06:11,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 23 msec 2023-07-23 10:06:11,668 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-23 10:06:11,672 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-23 10:06:11,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.764sec 2023-07-23 10:06:11,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-23 10:06:11,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-23 10:06:11,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-23 10:06:11,692 DEBUG [Listener at localhost/36111] zookeeper.ReadOnlyZKClient(139): Connect 0x76a534fc to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:11,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39043,1690106766136-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-23 10:06:11,694 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39043,1690106766136-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-23 10:06:11,712 DEBUG [Listener at localhost/36111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76ac257f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:11,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-23 10:06:11,732 DEBUG [hconnection-0x2eedeeb-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:11,733 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-23 10:06:11,738 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 10:06:11,739 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 10:06:11,743 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/hbase/acl/d7b2ad965da79b07eaeb88f95f4adbe8 2023-07-23 10:06:11,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-23 10:06:11,744 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/hbase/acl/d7b2ad965da79b07eaeb88f95f4adbe8 empty. 2023-07-23 10:06:11,747 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/hbase/acl/d7b2ad965da79b07eaeb88f95f4adbe8 2023-07-23 10:06:11,747 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-23 10:06:11,755 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55240, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:11,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 10:06:11,758 INFO [Listener at localhost/36111] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39043,1690106766136 2023-07-23 10:06:11,758 INFO [Listener at localhost/36111] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-23 10:06:11,758 INFO [Listener at localhost/36111] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/test.cache.data in system properties and HBase conf 2023-07-23 10:06:11,758 INFO [Listener at localhost/36111] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/hadoop.tmp.dir in system properties and HBase conf 2023-07-23 10:06:11,758 INFO [Listener at localhost/36111] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/hadoop.log.dir in system properties and HBase conf 2023-07-23 10:06:11,758 INFO [Listener at localhost/36111] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-23 10:06:11,758 INFO [Listener at localhost/36111] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-23 10:06:11,758 INFO [Listener at localhost/36111] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-23 10:06:11,758 INFO [Listener at localhost/36111] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-23 10:06:11,759 INFO [Listener at localhost/36111] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-23 10:06:11,762 INFO [Listener at localhost/36111] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-23 10:06:11,763 INFO [Listener at localhost/36111] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 10:06:11,763 INFO [Listener at localhost/36111] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-23 10:06:11,763 INFO [Listener at localhost/36111] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-23 10:06:11,763 INFO [Listener at localhost/36111] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 10:06:11,763 INFO [Listener at localhost/36111] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 10:06:11,763 INFO [Listener at localhost/36111] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-23 10:06:11,763 INFO [Listener at localhost/36111] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/nfs.dump.dir in system properties and HBase conf 2023-07-23 10:06:11,764 INFO [Listener at localhost/36111] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/java.io.tmpdir in system properties and HBase conf 2023-07-23 10:06:11,764 INFO [Listener at localhost/36111] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 10:06:11,764 INFO [Listener at localhost/36111] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-23 10:06:11,766 INFO [Listener at localhost/36111] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-23 10:06:11,800 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-23 10:06:11,802 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => d7b2ad965da79b07eaeb88f95f4adbe8, NAME => 'hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp 2023-07-23 10:06:11,857 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:11,857 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing d7b2ad965da79b07eaeb88f95f4adbe8, disabling compactions & flushes 2023-07-23 10:06:11,858 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8. 2023-07-23 10:06:11,858 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8. 2023-07-23 10:06:11,858 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8. after waiting 0 ms 2023-07-23 10:06:11,858 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8. 2023-07-23 10:06:11,858 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8. 2023-07-23 10:06:11,858 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for d7b2ad965da79b07eaeb88f95f4adbe8: 2023-07-23 10:06:11,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 10:06:11,867 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 10:06:11,869 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690106771868"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106771868"}]},"ts":"1690106771868"} 2023-07-23 10:06:11,880 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-23 10:06:11,882 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 10:06:11,883 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106771883"}]},"ts":"1690106771883"} 2023-07-23 10:06:11,886 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-23 10:06:11,891 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 10:06:11,893 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 10:06:11,893 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 10:06:11,893 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 10:06:11,893 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 10:06:11,893 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=d7b2ad965da79b07eaeb88f95f4adbe8, ASSIGN}] 2023-07-23 10:06:11,903 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=d7b2ad965da79b07eaeb88f95f4adbe8, ASSIGN 2023-07-23 10:06:11,905 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=d7b2ad965da79b07eaeb88f95f4adbe8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43301,1690106767667; forceNewPlan=false, retain=false 2023-07-23 10:06:12,055 INFO [jenkins-hbase4:39043] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-23 10:06:12,056 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d7b2ad965da79b07eaeb88f95f4adbe8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:12,057 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690106772056"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106772056"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106772056"}]},"ts":"1690106772056"} 2023-07-23 10:06:12,060 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure d7b2ad965da79b07eaeb88f95f4adbe8, server=jenkins-hbase4.apache.org,43301,1690106767667}] 2023-07-23 10:06:12,066 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 10:06:12,217 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:12,217 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 10:06:12,221 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 10:06:12,228 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8. 2023-07-23 10:06:12,228 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d7b2ad965da79b07eaeb88f95f4adbe8, NAME => 'hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8.', STARTKEY => '', ENDKEY => ''} 2023-07-23 10:06:12,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8. service=AccessControlService 2023-07-23 10:06:12,229 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:12,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl d7b2ad965da79b07eaeb88f95f4adbe8 2023-07-23 10:06:12,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:12,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d7b2ad965da79b07eaeb88f95f4adbe8 2023-07-23 10:06:12,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d7b2ad965da79b07eaeb88f95f4adbe8 2023-07-23 10:06:12,234 INFO [StoreOpener-d7b2ad965da79b07eaeb88f95f4adbe8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region d7b2ad965da79b07eaeb88f95f4adbe8 2023-07-23 10:06:12,236 DEBUG [StoreOpener-d7b2ad965da79b07eaeb88f95f4adbe8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/acl/d7b2ad965da79b07eaeb88f95f4adbe8/l 2023-07-23 10:06:12,236 DEBUG [StoreOpener-d7b2ad965da79b07eaeb88f95f4adbe8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/acl/d7b2ad965da79b07eaeb88f95f4adbe8/l 2023-07-23 10:06:12,237 INFO [StoreOpener-d7b2ad965da79b07eaeb88f95f4adbe8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7b2ad965da79b07eaeb88f95f4adbe8 columnFamilyName l 2023-07-23 10:06:12,238 INFO [StoreOpener-d7b2ad965da79b07eaeb88f95f4adbe8-1] regionserver.HStore(310): Store=d7b2ad965da79b07eaeb88f95f4adbe8/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:12,240 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/acl/d7b2ad965da79b07eaeb88f95f4adbe8 2023-07-23 10:06:12,242 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/acl/d7b2ad965da79b07eaeb88f95f4adbe8 2023-07-23 10:06:12,249 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d7b2ad965da79b07eaeb88f95f4adbe8 2023-07-23 10:06:12,254 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/acl/d7b2ad965da79b07eaeb88f95f4adbe8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:06:12,255 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d7b2ad965da79b07eaeb88f95f4adbe8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62072568, jitterRate=-0.07504665851593018}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:06:12,256 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d7b2ad965da79b07eaeb88f95f4adbe8: 2023-07-23 10:06:12,258 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8., pid=11, masterSystemTime=1690106772217 2023-07-23 10:06:12,262 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8. 2023-07-23 10:06:12,262 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8. 2023-07-23 10:06:12,263 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d7b2ad965da79b07eaeb88f95f4adbe8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:12,263 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690106772263"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106772263"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106772263"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106772263"}]},"ts":"1690106772263"} 2023-07-23 10:06:12,271 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-23 10:06:12,271 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure d7b2ad965da79b07eaeb88f95f4adbe8, server=jenkins-hbase4.apache.org,43301,1690106767667 in 207 msec 2023-07-23 10:06:12,278 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-23 10:06:12,278 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=d7b2ad965da79b07eaeb88f95f4adbe8, ASSIGN in 378 msec 2023-07-23 10:06:12,279 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 10:06:12,280 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106772280"}]},"ts":"1690106772280"} 2023-07-23 10:06:12,284 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-23 10:06:12,289 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 10:06:12,296 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 559 msec 2023-07-23 10:06:12,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 10:06:12,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-23 10:06:12,378 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-23 10:06:13,134 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 10:06:13,448 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 10:06:13,454 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38365_jobhistory____5kkpp2/webapp 2023-07-23 10:06:13,621 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-23 10:06:13,622 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-23 10:06:13,622 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 10:06:13,625 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 10:06:13,713 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 10:06:14,060 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 10:06:14,451 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-23 10:06:14,516 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38365 2023-07-23 10:06:16,098 WARN [Listener at jenkins-hbase4.apache.org/37233] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 10:06:16,352 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 10:06:16,453 WARN [Listener at jenkins-hbase4.apache.org/37233] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-23 10:06:16,453 INFO [Listener at jenkins-hbase4.apache.org/37233] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 10:06:16,466 INFO [Listener at jenkins-hbase4.apache.org/37233] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37455_cluster____vqysok/webapp 2023-07-23 10:06:16,484 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-23 10:06:16,486 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-23 10:06:16,487 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-23 10:06:16,488 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:06:16,489 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-23 10:06:16,489 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:06:16,490 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-23 10:06:16,490 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-23 10:06:16,490 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-23 10:06:16,490 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:06:16,490 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-23 10:06:16,490 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-23 10:06:16,490 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-23 10:06:16,545 INFO [Listener at jenkins-hbase4.apache.org/37233] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-23 10:06:16,545 INFO [Listener at jenkins-hbase4.apache.org/37233] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-23 10:06:16,545 INFO [Listener at jenkins-hbase4.apache.org/37233] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 10:06:16,546 INFO [Listener at jenkins-hbase4.apache.org/37233] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 10:06:16,553 INFO [Listener at jenkins-hbase4.apache.org/37233] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 10:06:16,738 INFO [Listener at jenkins-hbase4.apache.org/37233] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 10:06:16,850 INFO [Listener at jenkins-hbase4.apache.org/37233] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 10:06:16,858 INFO [Listener at jenkins-hbase4.apache.org/37233] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37455 2023-07-23 10:06:17,374 WARN [Listener at jenkins-hbase4.apache.org/35609] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 10:06:17,398 WARN [Listener at jenkins-hbase4.apache.org/35609] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-23 10:06:17,398 INFO [Listener at jenkins-hbase4.apache.org/35609] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 10:06:17,404 INFO [Listener at jenkins-hbase4.apache.org/35609] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40963_node____pczbaw/webapp 2023-07-23 10:06:17,455 INFO [Listener at jenkins-hbase4.apache.org/35609] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-23 10:06:17,455 INFO [Listener at jenkins-hbase4.apache.org/35609] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 10:06:17,456 INFO [Listener at jenkins-hbase4.apache.org/35609] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-23 10:06:17,456 INFO [Listener at jenkins-hbase4.apache.org/35609] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 10:06:17,463 INFO [Listener at jenkins-hbase4.apache.org/35609] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 10:06:17,482 INFO [Listener at jenkins-hbase4.apache.org/35609] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 10:06:17,562 INFO [Listener at jenkins-hbase4.apache.org/35609] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 10:06:17,578 INFO [Listener at jenkins-hbase4.apache.org/35609] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40963 2023-07-23 10:06:17,784 WARN [Listener at jenkins-hbase4.apache.org/44999] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 10:06:17,793 WARN [Listener at jenkins-hbase4.apache.org/44999] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-23 10:06:17,794 INFO [Listener at jenkins-hbase4.apache.org/44999] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 10:06:17,802 INFO [Listener at jenkins-hbase4.apache.org/44999] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35081_node____6hbdtx/webapp 2023-07-23 10:06:17,878 INFO [Listener at jenkins-hbase4.apache.org/44999] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-23 10:06:17,878 INFO [Listener at jenkins-hbase4.apache.org/44999] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 10:06:17,878 INFO [Listener at jenkins-hbase4.apache.org/44999] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-23 10:06:17,878 INFO [Listener at jenkins-hbase4.apache.org/44999] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 10:06:17,889 INFO [Listener at jenkins-hbase4.apache.org/44999] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 10:06:17,908 INFO [Listener at jenkins-hbase4.apache.org/44999] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 10:06:18,002 INFO [Listener at jenkins-hbase4.apache.org/44999] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 10:06:18,009 INFO [Listener at jenkins-hbase4.apache.org/44999] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35081 2023-07-23 10:06:18,045 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-23 10:06:18,047 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:06:18,130 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=710, OpenFileDescriptor=912, MaxFileDescriptor=60000, SystemLoadAverage=153, ProcessCount=173, AvailableMemoryMB=8254 2023-07-23 10:06:18,130 WARN [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(130): Thread=710 is superior to 500 2023-07-23 10:06:18,145 DEBUG [Listener at jenkins-hbase4.apache.org/44999] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-23 10:06:18,152 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-23 10:06:18,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 10:06:18,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-23 10:06:18,168 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 10:06:18,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-23 10:06:18,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 10:06:18,170 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 10:06:18,174 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportWithTargetName/a391c5fad4223f142f297f025269fc0c 2023-07-23 10:06:18,174 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportWithTargetName/cf64fbd2e104fbe88122fda7c15f6c06 2023-07-23 10:06:18,175 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportWithTargetName/a391c5fad4223f142f297f025269fc0c empty. 2023-07-23 10:06:18,176 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportWithTargetName/cf64fbd2e104fbe88122fda7c15f6c06 empty. 2023-07-23 10:06:18,177 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportWithTargetName/a391c5fad4223f142f297f025269fc0c 2023-07-23 10:06:18,178 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportWithTargetName/cf64fbd2e104fbe88122fda7c15f6c06 2023-07-23 10:06:18,178 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-23 10:06:18,214 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-23 10:06:18,216 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => a391c5fad4223f142f297f025269fc0c, NAME => 'testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp 2023-07-23 10:06:18,217 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => cf64fbd2e104fbe88122fda7c15f6c06, NAME => 'testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp 2023-07-23 10:06:18,254 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:18,255 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing a391c5fad4223f142f297f025269fc0c, disabling compactions & flushes 2023-07-23 10:06:18,255 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. 2023-07-23 10:06:18,255 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:18,256 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing cf64fbd2e104fbe88122fda7c15f6c06, disabling compactions & flushes 2023-07-23 10:06:18,256 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06. 2023-07-23 10:06:18,256 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06. 2023-07-23 10:06:18,256 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06. after waiting 0 ms 2023-07-23 10:06:18,255 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. 2023-07-23 10:06:18,256 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06. 2023-07-23 10:06:18,257 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. after waiting 0 ms 2023-07-23 10:06:18,257 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. 2023-07-23 10:06:18,257 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06. 2023-07-23 10:06:18,257 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. 2023-07-23 10:06:18,257 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for cf64fbd2e104fbe88122fda7c15f6c06: 2023-07-23 10:06:18,257 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for a391c5fad4223f142f297f025269fc0c: 2023-07-23 10:06:18,261 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 10:06:18,262 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690106778262"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106778262"}]},"ts":"1690106778262"} 2023-07-23 10:06:18,263 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690106778262"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106778262"}]},"ts":"1690106778262"} 2023-07-23 10:06:18,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 10:06:18,310 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 10:06:18,312 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 10:06:18,312 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106778312"}]},"ts":"1690106778312"} 2023-07-23 10:06:18,314 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-23 10:06:18,320 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 10:06:18,322 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 10:06:18,322 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 10:06:18,322 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 10:06:18,322 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 10:06:18,323 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a391c5fad4223f142f297f025269fc0c, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf64fbd2e104fbe88122fda7c15f6c06, ASSIGN}] 2023-07-23 10:06:18,326 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf64fbd2e104fbe88122fda7c15f6c06, ASSIGN 2023-07-23 10:06:18,326 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a391c5fad4223f142f297f025269fc0c, ASSIGN 2023-07-23 10:06:18,327 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a391c5fad4223f142f297f025269fc0c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44315,1690106767755; forceNewPlan=false, retain=false 2023-07-23 10:06:18,327 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf64fbd2e104fbe88122fda7c15f6c06, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43301,1690106767667; forceNewPlan=false, retain=false 2023-07-23 10:06:18,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 10:06:18,477 INFO [jenkins-hbase4:39043] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 10:06:18,479 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=cf64fbd2e104fbe88122fda7c15f6c06, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:18,480 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a391c5fad4223f142f297f025269fc0c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:18,480 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690106778479"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106778479"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106778479"}]},"ts":"1690106778479"} 2023-07-23 10:06:18,480 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690106778479"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106778479"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106778479"}]},"ts":"1690106778479"} 2023-07-23 10:06:18,483 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure cf64fbd2e104fbe88122fda7c15f6c06, server=jenkins-hbase4.apache.org,43301,1690106767667}] 2023-07-23 10:06:18,485 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure a391c5fad4223f142f297f025269fc0c, server=jenkins-hbase4.apache.org,44315,1690106767755}] 2023-07-23 10:06:18,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. 2023-07-23 10:06:18,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06. 2023-07-23 10:06:18,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a391c5fad4223f142f297f025269fc0c, NAME => 'testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 10:06:18,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cf64fbd2e104fbe88122fda7c15f6c06, NAME => 'testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 10:06:18,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. service=AccessControlService 2023-07-23 10:06:18,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06. service=AccessControlService 2023-07-23 10:06:18,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:18,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:18,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName a391c5fad4223f142f297f025269fc0c 2023-07-23 10:06:18,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName cf64fbd2e104fbe88122fda7c15f6c06 2023-07-23 10:06:18,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:18,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:18,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a391c5fad4223f142f297f025269fc0c 2023-07-23 10:06:18,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cf64fbd2e104fbe88122fda7c15f6c06 2023-07-23 10:06:18,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a391c5fad4223f142f297f025269fc0c 2023-07-23 10:06:18,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cf64fbd2e104fbe88122fda7c15f6c06 2023-07-23 10:06:18,646 INFO [StoreOpener-a391c5fad4223f142f297f025269fc0c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a391c5fad4223f142f297f025269fc0c 2023-07-23 10:06:18,646 INFO [StoreOpener-cf64fbd2e104fbe88122fda7c15f6c06-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cf64fbd2e104fbe88122fda7c15f6c06 2023-07-23 10:06:18,648 DEBUG [StoreOpener-a391c5fad4223f142f297f025269fc0c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/a391c5fad4223f142f297f025269fc0c/cf 2023-07-23 10:06:18,648 DEBUG [StoreOpener-a391c5fad4223f142f297f025269fc0c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/a391c5fad4223f142f297f025269fc0c/cf 2023-07-23 10:06:18,648 DEBUG [StoreOpener-cf64fbd2e104fbe88122fda7c15f6c06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/cf64fbd2e104fbe88122fda7c15f6c06/cf 2023-07-23 10:06:18,648 DEBUG [StoreOpener-cf64fbd2e104fbe88122fda7c15f6c06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/cf64fbd2e104fbe88122fda7c15f6c06/cf 2023-07-23 10:06:18,649 INFO [StoreOpener-a391c5fad4223f142f297f025269fc0c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a391c5fad4223f142f297f025269fc0c columnFamilyName cf 2023-07-23 10:06:18,649 INFO [StoreOpener-cf64fbd2e104fbe88122fda7c15f6c06-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf64fbd2e104fbe88122fda7c15f6c06 columnFamilyName cf 2023-07-23 10:06:18,649 INFO [StoreOpener-a391c5fad4223f142f297f025269fc0c-1] regionserver.HStore(310): Store=a391c5fad4223f142f297f025269fc0c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:18,651 INFO [StoreOpener-cf64fbd2e104fbe88122fda7c15f6c06-1] regionserver.HStore(310): Store=cf64fbd2e104fbe88122fda7c15f6c06/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:18,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/cf64fbd2e104fbe88122fda7c15f6c06 2023-07-23 10:06:18,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/a391c5fad4223f142f297f025269fc0c 2023-07-23 10:06:18,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/cf64fbd2e104fbe88122fda7c15f6c06 2023-07-23 10:06:18,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/a391c5fad4223f142f297f025269fc0c 2023-07-23 10:06:18,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cf64fbd2e104fbe88122fda7c15f6c06 2023-07-23 10:06:18,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a391c5fad4223f142f297f025269fc0c 2023-07-23 10:06:18,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/cf64fbd2e104fbe88122fda7c15f6c06/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:06:18,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cf64fbd2e104fbe88122fda7c15f6c06; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64918905, jitterRate=-0.03263293206691742}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:06:18,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cf64fbd2e104fbe88122fda7c15f6c06: 2023-07-23 10:06:18,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/a391c5fad4223f142f297f025269fc0c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:06:18,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a391c5fad4223f142f297f025269fc0c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71241297, jitterRate=0.06157805025577545}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:06:18,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a391c5fad4223f142f297f025269fc0c: 2023-07-23 10:06:18,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06., pid=15, masterSystemTime=1690106778636 2023-07-23 10:06:18,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c., pid=16, masterSystemTime=1690106778637 2023-07-23 10:06:18,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06. 2023-07-23 10:06:18,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06. 2023-07-23 10:06:18,674 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=cf64fbd2e104fbe88122fda7c15f6c06, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:18,674 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690106778674"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106778674"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106778674"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106778674"}]},"ts":"1690106778674"} 2023-07-23 10:06:18,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. 2023-07-23 10:06:18,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. 2023-07-23 10:06:18,676 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a391c5fad4223f142f297f025269fc0c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:18,678 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690106778676"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106778676"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106778676"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106778676"}]},"ts":"1690106778676"} 2023-07-23 10:06:18,682 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-23 10:06:18,682 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure cf64fbd2e104fbe88122fda7c15f6c06, server=jenkins-hbase4.apache.org,43301,1690106767667 in 196 msec 2023-07-23 10:06:18,684 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-23 10:06:18,687 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure a391c5fad4223f142f297f025269fc0c, server=jenkins-hbase4.apache.org,44315,1690106767755 in 196 msec 2023-07-23 10:06:18,688 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf64fbd2e104fbe88122fda7c15f6c06, ASSIGN in 359 msec 2023-07-23 10:06:18,691 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-23 10:06:18,691 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a391c5fad4223f142f297f025269fc0c, ASSIGN in 364 msec 2023-07-23 10:06:18,692 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 10:06:18,692 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106778692"}]},"ts":"1690106778692"} 2023-07-23 10:06:18,694 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-23 10:06:18,698 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 10:06:18,704 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-23 10:06:18,712 DEBUG [PEWorker-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:18,716 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58962, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:18,720 DEBUG [hconnection-0x56bffd36-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:18,722 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55246, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-07-23 10:06:18,731 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-23 10:06:18,767 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:18,767 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:18,767 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 10:06:18,767 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:18,768 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:18,774 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:18,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 10:06:18,780 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:18,780 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:18,781 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:18,783 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:18,783 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 619 msec 2023-07-23 10:06:19,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 10:06:19,281 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-23 10:06:19,281 DEBUG [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-23 10:06:19,283 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:06:19,294 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-23 10:06:19,295 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:06:19,295 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-23 10:06:19,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 10:06:19,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106779312 (current time:1690106779312). 2023-07-23 10:06:19,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:06:19,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x657d0c21 to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:19,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f6bfffc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:19,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:19,333 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:19,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x657d0c21 to 127.0.0.1:61286 2023-07-23 10:06:19,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:19,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x6ace549c to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:19,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36cd9de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:19,352 DEBUG [hconnection-0x2e428eb6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:19,353 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:19,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:19,362 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:19,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ace549c to 127.0.0.1:61286 2023-07-23 10:06:19,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:19,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-23 10:06:19,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:06:19,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 10:06:19,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 10:06:19,421 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 10:06:19,422 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690107379422 2023-07-23 10:06:19,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 10:06:19,425 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-23 10:06:19,428 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 10:06:19,430 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 17 msec 2023-07-23 10:06:19,430 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:06:19,431 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:06:19,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 10:06:19,433 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 10:06:19,434 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690107379434 2023-07-23 10:06:19,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,470 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-23 10:06:19,471 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:19,471 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-23 10:06:19,471 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-23 10:06:19,472 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,472 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,476 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:19,477 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:19,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:19,476 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:19,476 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:19,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:19,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:19,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:19,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:19,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:19,477 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:19,477 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:19,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,478 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:19,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,478 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:06:19,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-23 10:06:19,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-23 10:06:19,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-23 10:06:19,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,479 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 10:06:19,479 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 10:06:19,479 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 10:06:19,482 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,482 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,482 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,482 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 10:06:19,482 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:19,482 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 10:06:19,483 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:19,488 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 10:06:19,488 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 10:06:19,488 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-23 10:06:19,488 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-23 10:06:19,488 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44315,1690106767755' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-23 10:06:19,488 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 10:06:19,488 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-23 10:06:19,488 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:19,489 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 10:06:19,489 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-23 10:06:19,489 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35943,1690106767812' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-23 10:06:19,492 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,492 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:19,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:19,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:19,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:19,493 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:19,493 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:19,494 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,494 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,494 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:19,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:19,499 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,499 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:19,499 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,499 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:19,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:19,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:19,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:19,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:19,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-23 10:06:19,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b70d0d3[Count = 1] remaining members to acquire global barrier 2023-07-23 10:06:19,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:19,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:19,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:19,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:19,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:19,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:19,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:19,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:19,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:19,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44315,1690106767755' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-23 10:06:19,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b70d0d3[Count = 0] remaining members to acquire global barrier 2023-07-23 10:06:19,505 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-23 10:06:19,505 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,508 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,508 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,508 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,509 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 10:06:19,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,509 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 10:06:19,509 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:19,510 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:19,510 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:06:19,510 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:19,511 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:19,509 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 10:06:19,511 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. 2023-07-23 10:06:19,509 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-23 10:06:19,514 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35943,1690106767812' in zk 2023-07-23 10:06:19,514 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. started... 2023-07-23 10:06:19,515 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:19,515 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:19,517 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06. 2023-07-23 10:06:19,517 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06. started... 2023-07-23 10:06:19,518 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 10:06:19,519 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:19,519 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-23 10:06:19,520 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a391c5fad4223f142f297f025269fc0c: 2023-07-23 10:06:19,520 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cf64fbd2e104fbe88122fda7c15f6c06: 2023-07-23 10:06:19,522 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,528 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,531 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:19,531 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:19,531 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:19,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 10:06:19,536 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:06:19,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:06:19,538 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:06:19,538 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:06:19,571 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. completed. 2023-07-23 10:06:19,574 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. 2023-07-23 10:06:19,575 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:19,575 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:19,576 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:19,576 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-23 10:06:19,576 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44315,1690106767755' in zk 2023-07-23 10:06:19,579 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:19,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:19,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:19,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:19,579 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 10:06:19,579 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:19,579 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-23 10:06:19,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:19,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:19,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,582 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06. completed. 2023-07-23 10:06:19,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:19,582 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06. 2023-07-23 10:06:19,583 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:19,583 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:19,583 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:19,583 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-23 10:06:19,583 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43301,1690106767667' in zk 2023-07-23 10:06:19,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:19,588 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:19,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:19,589 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 10:06:19,589 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:19,589 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-23 10:06:19,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:19,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:19,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:19,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:19,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44315,1690106767755': 2023-07-23 10:06:19,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44315,1690106767755' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-23 10:06:19,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:19,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:19,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:19,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:19,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:19,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:19,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:19,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:19,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:19,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:19,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:19,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:19,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43301,1690106767667': 2023-07-23 10:06:19,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-23 10:06:19,598 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-23 10:06:19,599 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:06:19,599 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:06:19,599 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,599 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:06:19,608 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,608 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,608 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:19,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:19,608 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,608 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:19,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,609 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:19,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:19,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,608 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:19,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:19,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:19,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,609 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:19,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:19,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:19,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:19,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,610 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:19,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:19,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:19,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,611 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:19,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:19,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:19,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:19,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:19,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,614 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:19,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:19,614 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:19,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:19,614 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:19,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:19,630 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:19,630 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:19,630 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:19,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:19,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:19,630 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:19,631 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:19,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:19,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:19,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:19,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:19,631 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:19,631 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:19,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:19,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:19,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:19,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:19,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:19,631 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:19,631 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,631 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:19,633 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:19,633 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:19,633 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,633 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:19,633 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,633 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:19,633 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:19,633 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,633 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,738 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:19,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 10:06:19,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:06:19,767 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 10:06:19,771 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-23 10:06:19,772 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,772 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:19,773 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690106779425Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1690106779633 (+208 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1690106779633Writing data manifest for emptySnaptb0-testExportWithTargetName at 1690106779646 (+13 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1690106779665 (+19 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690106779771 (+106 ms) 2023-07-23 10:06:19,774 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 10:06:19,777 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 343 msec 2023-07-23 10:06:20,067 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:20,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 10:06:20,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:06:20,095 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:20,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44315] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:06:20,102 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:20,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43301] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:06:20,119 DEBUG [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-23 10:06:20,120 DEBUG [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. 2023-07-23 10:06:20,123 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:06:20,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 10:06:20,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106780183 (current time:1690106780183). 2023-07-23 10:06:20,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:06:20,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x16f3112d to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:20,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d055764, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:20,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:20,205 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:20,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16f3112d to 127.0.0.1:61286 2023-07-23 10:06:20,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:20,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x2a500335 to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:20,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24a4152b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:20,217 DEBUG [hconnection-0x132dd8ac-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:20,220 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55280, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:20,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:20,228 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58992, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:20,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a500335 to 127.0.0.1:61286 2023-07-23 10:06:20,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:20,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-23 10:06:20,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:06:20,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 10:06:20,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 10:06:20,245 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 10:06:20,246 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690107380246 2023-07-23 10:06:20,246 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-23 10:06:20,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 10:06:20,248 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:06:20,249 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:06:20,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 10:06:20,251 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 10:06:20,254 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 11 msec 2023-07-23 10:06:20,255 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 10:06:20,257 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690107380257 2023-07-23 10:06:20,296 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-23 10:06:20,296 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-23 10:06:20,296 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:20,297 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-23 10:06:20,297 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-23 10:06:20,298 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,298 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,299 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:20,299 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:20,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:20,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:20,299 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:20,299 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:20,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:20,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:20,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,300 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:20,300 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:20,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,301 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:20,301 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:06:20,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-23 10:06:20,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-23 10:06:20,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-23 10:06:20,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,302 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 10:06:20,302 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 10:06:20,302 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 10:06:20,303 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-23 10:06:20,303 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 10:06:20,303 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-23 10:06:20,303 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:20,303 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 10:06:20,303 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:20,318 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-23 10:06:20,332 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 10:06:20,332 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 10:06:20,332 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-23 10:06:20,332 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-23 10:06:20,332 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 10:06:20,332 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-23 10:06:20,332 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35943,1690106767812' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-23 10:06:20,332 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:20,334 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 10:06:20,334 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-23 10:06:20,334 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44315,1690106767755' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-23 10:06:20,345 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,345 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,345 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,345 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:20,345 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,345 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:20,346 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:20,346 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:20,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:20,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:20,346 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:20,347 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,347 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:20,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:20,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:20,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 10:06:20,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:20,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:20,349 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:20,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:20,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:20,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-23 10:06:20,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1600eb2f[Count = 1] remaining members to acquire global barrier 2023-07-23 10:06:20,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:20,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:20,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:20,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 10:06:20,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:06:20,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:20,351 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:06:20,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:20,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 10:06:20,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:20,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:20,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:20,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:20,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44315,1690106767755' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-23 10:06:20,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1600eb2f[Count = 0] remaining members to acquire global barrier 2023-07-23 10:06:20,356 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-23 10:06:20,356 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,361 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,361 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,362 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,362 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:20,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,362 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 10:06:20,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,362 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 10:06:20,362 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 10:06:20,362 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-23 10:06:20,363 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. 2023-07-23 10:06:20,362 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:20,363 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:06:20,362 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:20,363 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:20,363 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06. 2023-07-23 10:06:20,363 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:20,363 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06. started... 2023-07-23 10:06:20,363 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. started... 2023-07-23 10:06:20,363 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35943,1690106767812' in zk 2023-07-23 10:06:20,363 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:20,363 INFO [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a391c5fad4223f142f297f025269fc0c 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-23 10:06:20,363 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cf64fbd2e104fbe88122fda7c15f6c06 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-23 10:06:20,366 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 10:06:20,366 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:20,366 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-23 10:06:20,506 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/cf64fbd2e104fbe88122fda7c15f6c06/.tmp/cf/5aab64cee4a048698e20c0322ea4cc18 2023-07-23 10:06:20,506 INFO [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/a391c5fad4223f142f297f025269fc0c/.tmp/cf/99ab70fe92b04a28be0d74a1c11451f5 2023-07-23 10:06:20,551 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:20,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 10:06:20,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:06:20,553 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 10:06:20,563 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/cf64fbd2e104fbe88122fda7c15f6c06/.tmp/cf/5aab64cee4a048698e20c0322ea4cc18 as hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/cf64fbd2e104fbe88122fda7c15f6c06/cf/5aab64cee4a048698e20c0322ea4cc18 2023-07-23 10:06:20,563 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/a391c5fad4223f142f297f025269fc0c/.tmp/cf/99ab70fe92b04a28be0d74a1c11451f5 as hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/a391c5fad4223f142f297f025269fc0c/cf/99ab70fe92b04a28be0d74a1c11451f5 2023-07-23 10:06:20,574 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/cf64fbd2e104fbe88122fda7c15f6c06/cf/5aab64cee4a048698e20c0322ea4cc18, entries=48, sequenceid=6, filesize=8.1 K 2023-07-23 10:06:20,577 INFO [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/a391c5fad4223f142f297f025269fc0c/cf/99ab70fe92b04a28be0d74a1c11451f5, entries=2, sequenceid=6, filesize=5.0 K 2023-07-23 10:06:20,580 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for cf64fbd2e104fbe88122fda7c15f6c06 in 217ms, sequenceid=6, compaction requested=false 2023-07-23 10:06:20,580 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-23 10:06:20,581 INFO [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for a391c5fad4223f142f297f025269fc0c in 218ms, sequenceid=6, compaction requested=false 2023-07-23 10:06:20,581 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-23 10:06:20,582 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cf64fbd2e104fbe88122fda7c15f6c06: 2023-07-23 10:06:20,583 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-23 10:06:20,583 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:20,583 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/cf64fbd2e104fbe88122fda7c15f6c06/cf/5aab64cee4a048698e20c0322ea4cc18] hfiles 2023-07-23 10:06:20,583 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/cf64fbd2e104fbe88122fda7c15f6c06/cf/5aab64cee4a048698e20c0322ea4cc18 for snapshot=snaptb0-testExportWithTargetName 2023-07-23 10:06:20,590 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a391c5fad4223f142f297f025269fc0c: 2023-07-23 10:06:20,590 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-23 10:06:20,590 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:20,591 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/a391c5fad4223f142f297f025269fc0c/cf/99ab70fe92b04a28be0d74a1c11451f5] hfiles 2023-07-23 10:06:20,591 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/a391c5fad4223f142f297f025269fc0c/cf/99ab70fe92b04a28be0d74a1c11451f5 for snapshot=snaptb0-testExportWithTargetName 2023-07-23 10:06:20,634 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. completed. 2023-07-23 10:06:20,634 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. 2023-07-23 10:06:20,634 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:20,634 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:20,634 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:20,634 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-23 10:06:20,634 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44315,1690106767755' in zk 2023-07-23 10:06:20,637 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:20,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:20,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:20,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:20,637 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 10:06:20,637 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:20,637 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-23 10:06:20,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:20,639 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06. completed. 2023-07-23 10:06:20,639 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06. 2023-07-23 10:06:20,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:20,639 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:20,639 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:20,639 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:20,639 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-23 10:06:20,639 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43301,1690106767667' in zk 2023-07-23 10:06:20,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 10:06:20,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:20,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:20,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:20,643 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 10:06:20,643 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:20,643 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-23 10:06:20,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:20,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 10:06:20,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:20,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:20,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:20,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44315,1690106767755': 2023-07-23 10:06:20,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44315,1690106767755' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-23 10:06:20,654 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:20,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:20,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:20,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:20,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:20,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:20,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 10:06:20,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:20,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:20,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:20,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:20,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 10:06:20,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:20,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:20,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:20,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43301,1690106767667': 2023-07-23 10:06:20,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-23 10:06:20,661 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-23 10:06:20,661 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:06:20,661 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:06:20,661 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-23 10:06:20,661 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:06:20,663 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,663 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,663 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,663 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:20,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,663 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,663 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:20,663 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:20,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,664 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:20,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:20,664 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:20,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:20,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:20,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:20,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:20,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:20,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:20,664 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:20,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:20,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:20,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 10:06:20,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:20,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 10:06:20,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:20,667 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:20,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:20,668 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:20,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:20,668 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:20,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:20,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 10:06:20,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:20,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:20,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:20,681 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:20,681 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,681 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:20,682 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:20,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:20,682 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:20,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:20,682 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:20,682 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:20,682 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName because node does not exist (not an error) 2023-07-23 10:06:20,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:20,682 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:20,682 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:20,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:20,682 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,682 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:20,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:20,682 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,682 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-23 10:06:20,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:20,682 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:20,682 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:20,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:20,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:20,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-23 10:06:20,683 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:20,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:20,684 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:20,684 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:20,684 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:20,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:20,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,787 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-23 10:06:20,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,787 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-23 10:06:20,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690106780247Consolidate snapshot: snaptb0-testExportWithTargetName at 1690106780683 (+436 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1690106780684 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1690106780690 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1690106780712 (+22 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690106780787 (+75 ms) 2023-07-23 10:06:20,789 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 10:06:20,792 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 541 msec 2023-07-23 10:06:20,854 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:20,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 10:06:20,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:06:20,857 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106780857 2023-07-23 10:06:20,857 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39321, tgtDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106780857, rawTgtDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106780857, srcFsUri=hdfs://localhost:39321, srcDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa 2023-07-23 10:06:20,909 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39321, inputRoot=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa 2023-07-23 10:06:20,909 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1943371548_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106780857, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106780857/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-23 10:06:20,910 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39321, inputRoot=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa, snapshotDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-23 10:06:20,933 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106780857/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-23 10:06:21,015 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:21,016 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:21,017 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:21,017 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:21,018 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:21,018 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:21,019 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:21,105 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/hadoop-1252236149073856298.jar 2023-07-23 10:06:21,106 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:21,107 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:21,107 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:21,108 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:21,108 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:21,108 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:21,109 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 10:06:21,110 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 10:06:21,110 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 10:06:21,110 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 10:06:21,111 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 10:06:21,112 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 10:06:21,112 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 10:06:21,112 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 10:06:21,113 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 10:06:21,113 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 10:06:21,117 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:21,117 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:21,118 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:06:21,118 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:21,118 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:21,119 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:06:21,119 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:06:22,125 WARN [Listener at jenkins-hbase4.apache.org/44999] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 10:06:22,132 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-23 10:06:22,142 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-23 10:06:22,709 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:06:22,711 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:06:23,174 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0001_000001 (auth:SIMPLE) 2023-07-23 10:06:24,166 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 10:06:28,369 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0001_000001 (auth:SIMPLE) 2023-07-23 10:06:30,636 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0001_000001 (auth:SIMPLE) 2023-07-23 10:06:34,217 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0001_000001 (auth:SIMPLE) 2023-07-23 10:06:36,135 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 10:06:36,138 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 10:06:36,152 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-23 10:06:36,152 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 10:06:36,153 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 10:06:36,153 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-372295689_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-23 10:06:36,154 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-23 10:06:36,154 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-23 10:06:36,155 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-372295689_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106780857/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106780857/.hbase-snapshot/testExportWithTargetName 2023-07-23 10:06:36,155 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106780857/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-23 10:06:36,155 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106780857/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-23 10:06:36,169 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-23 10:06:36,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-23 10:06:36,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-23 10:06:36,193 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106796193"}]},"ts":"1690106796193"} 2023-07-23 10:06:36,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-23 10:06:36,196 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-23 10:06:36,198 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-23 10:06:36,199 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a391c5fad4223f142f297f025269fc0c, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf64fbd2e104fbe88122fda7c15f6c06, UNASSIGN}] 2023-07-23 10:06:36,202 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a391c5fad4223f142f297f025269fc0c, UNASSIGN 2023-07-23 10:06:36,202 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf64fbd2e104fbe88122fda7c15f6c06, UNASSIGN 2023-07-23 10:06:36,203 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=a391c5fad4223f142f297f025269fc0c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:36,203 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=cf64fbd2e104fbe88122fda7c15f6c06, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:36,203 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690106796203"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106796203"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106796203"}]},"ts":"1690106796203"} 2023-07-23 10:06:36,203 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690106796203"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106796203"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106796203"}]},"ts":"1690106796203"} 2023-07-23 10:06:36,205 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure a391c5fad4223f142f297f025269fc0c, server=jenkins-hbase4.apache.org,44315,1690106767755}] 2023-07-23 10:06:36,206 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure cf64fbd2e104fbe88122fda7c15f6c06, server=jenkins-hbase4.apache.org,43301,1690106767667}] 2023-07-23 10:06:36,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-23 10:06:36,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cf64fbd2e104fbe88122fda7c15f6c06 2023-07-23 10:06:36,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a391c5fad4223f142f297f025269fc0c 2023-07-23 10:06:36,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cf64fbd2e104fbe88122fda7c15f6c06, disabling compactions & flushes 2023-07-23 10:06:36,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a391c5fad4223f142f297f025269fc0c, disabling compactions & flushes 2023-07-23 10:06:36,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06. 2023-07-23 10:06:36,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. 2023-07-23 10:06:36,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06. 2023-07-23 10:06:36,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. 2023-07-23 10:06:36,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06. after waiting 0 ms 2023-07-23 10:06:36,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. after waiting 0 ms 2023-07-23 10:06:36,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. 2023-07-23 10:06:36,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06. 2023-07-23 10:06:36,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/cf64fbd2e104fbe88122fda7c15f6c06/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:06:36,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportWithTargetName/a391c5fad4223f142f297f025269fc0c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:06:36,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:06:36,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:06:36,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c. 2023-07-23 10:06:36,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06. 2023-07-23 10:06:36,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a391c5fad4223f142f297f025269fc0c: 2023-07-23 10:06:36,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cf64fbd2e104fbe88122fda7c15f6c06: 2023-07-23 10:06:36,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a391c5fad4223f142f297f025269fc0c 2023-07-23 10:06:36,389 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=a391c5fad4223f142f297f025269fc0c, regionState=CLOSED 2023-07-23 10:06:36,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cf64fbd2e104fbe88122fda7c15f6c06 2023-07-23 10:06:36,389 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690106796389"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106796389"}]},"ts":"1690106796389"} 2023-07-23 10:06:36,390 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=cf64fbd2e104fbe88122fda7c15f6c06, regionState=CLOSED 2023-07-23 10:06:36,390 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690106796390"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106796390"}]},"ts":"1690106796390"} 2023-07-23 10:06:36,395 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-23 10:06:36,395 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure a391c5fad4223f142f297f025269fc0c, server=jenkins-hbase4.apache.org,44315,1690106767755 in 186 msec 2023-07-23 10:06:36,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-23 10:06:36,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure cf64fbd2e104fbe88122fda7c15f6c06, server=jenkins-hbase4.apache.org,43301,1690106767667 in 186 msec 2023-07-23 10:06:36,397 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a391c5fad4223f142f297f025269fc0c, UNASSIGN in 196 msec 2023-07-23 10:06:36,399 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-23 10:06:36,399 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf64fbd2e104fbe88122fda7c15f6c06, UNASSIGN in 197 msec 2023-07-23 10:06:36,400 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106796400"}]},"ts":"1690106796400"} 2023-07-23 10:06:36,401 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-23 10:06:36,403 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-23 10:06:36,406 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 224 msec 2023-07-23 10:06:36,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-23 10:06:36,497 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-23 10:06:36,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-23 10:06:36,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 10:06:36,512 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 10:06:36,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-23 10:06:36,514 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 10:06:36,517 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-23 10:06:36,520 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportWithTargetName/a391c5fad4223f142f297f025269fc0c 2023-07-23 10:06:36,520 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportWithTargetName/cf64fbd2e104fbe88122fda7c15f6c06 2023-07-23 10:06:36,521 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 10:06:36,521 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 10:06:36,521 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 10:06:36,521 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 10:06:36,523 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:36,523 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:36,523 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:36,523 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:36,523 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-23 10:06:36,523 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-23 10:06:36,523 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 10:06:36,523 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 10:06:36,523 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-23 10:06:36,523 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-23 10:06:36,523 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 10:06:36,523 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 10:06:36,524 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportWithTargetName/a391c5fad4223f142f297f025269fc0c/cf, FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportWithTargetName/a391c5fad4223f142f297f025269fc0c/recovered.edits] 2023-07-23 10:06:36,524 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportWithTargetName/cf64fbd2e104fbe88122fda7c15f6c06/cf, FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportWithTargetName/cf64fbd2e104fbe88122fda7c15f6c06/recovered.edits] 2023-07-23 10:06:36,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-23 10:06:36,531 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportWithTargetName/a391c5fad4223f142f297f025269fc0c/cf/99ab70fe92b04a28be0d74a1c11451f5 to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testExportWithTargetName/a391c5fad4223f142f297f025269fc0c/cf/99ab70fe92b04a28be0d74a1c11451f5 2023-07-23 10:06:36,532 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportWithTargetName/cf64fbd2e104fbe88122fda7c15f6c06/cf/5aab64cee4a048698e20c0322ea4cc18 to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testExportWithTargetName/cf64fbd2e104fbe88122fda7c15f6c06/cf/5aab64cee4a048698e20c0322ea4cc18 2023-07-23 10:06:36,535 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportWithTargetName/a391c5fad4223f142f297f025269fc0c/recovered.edits/9.seqid to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testExportWithTargetName/a391c5fad4223f142f297f025269fc0c/recovered.edits/9.seqid 2023-07-23 10:06:36,536 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportWithTargetName/cf64fbd2e104fbe88122fda7c15f6c06/recovered.edits/9.seqid to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testExportWithTargetName/cf64fbd2e104fbe88122fda7c15f6c06/recovered.edits/9.seqid 2023-07-23 10:06:36,536 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportWithTargetName/a391c5fad4223f142f297f025269fc0c 2023-07-23 10:06:36,536 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportWithTargetName/cf64fbd2e104fbe88122fda7c15f6c06 2023-07-23 10:06:36,537 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-23 10:06:36,539 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 10:06:36,560 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-23 10:06:36,563 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-23 10:06:36,565 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 10:06:36,565 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-23 10:06:36,565 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106796565"}]},"ts":"9223372036854775807"} 2023-07-23 10:06:36,565 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106796565"}]},"ts":"9223372036854775807"} 2023-07-23 10:06:36,568 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 10:06:36,568 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a391c5fad4223f142f297f025269fc0c, NAME => 'testtb-testExportWithTargetName,,1690106778161.a391c5fad4223f142f297f025269fc0c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cf64fbd2e104fbe88122fda7c15f6c06, NAME => 'testtb-testExportWithTargetName,1,1690106778161.cf64fbd2e104fbe88122fda7c15f6c06.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 10:06:36,568 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-23 10:06:36,568 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690106796568"}]},"ts":"9223372036854775807"} 2023-07-23 10:06:36,570 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-23 10:06:36,572 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 10:06:36,574 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 69 msec 2023-07-23 10:06:36,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-23 10:06:36,628 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-23 10:06:36,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-23 10:06:36,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:36,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-23 10:06:36,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-23 10:06:36,681 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=758 (was 710) Potentially hanging thread: hconnection-0x5a736194-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:35415 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x5a736194-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/cluster_bd390da2-1551-9369-9467-7621abdbc80d/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-372295689_17 at /127.0.0.1:60012 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/cluster_bd390da2-1551-9369-9467-7621abdbc80d/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a736194-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1281 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-372295689_17 at /127.0.0.1:56006 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:35609 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1872778594_1 at /127.0.0.1:40450 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/cluster_bd390da2-1551-9369-9467-7621abdbc80d/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/cluster_bd390da2-1551-9369-9467-7621abdbc80d/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:44203 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1872778594_1 at /127.0.0.1:55990 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/cluster_bd390da2-1551-9369-9467-7621abdbc80d/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a736194-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/cluster_bd390da2-1551-9369-9467-7621abdbc80d/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=936 (was 912) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=279 (was 153) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=6499 (was 8254) 2023-07-23 10:06:36,682 WARN [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-23 10:06:36,701 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=758, OpenFileDescriptor=936, MaxFileDescriptor=60000, SystemLoadAverage=279, ProcessCount=179, AvailableMemoryMB=6498 2023-07-23 10:06:36,701 WARN [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-23 10:06:36,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 10:06:36,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-23 10:06:36,707 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 10:06:36,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-23 10:06:36,709 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 10:06:36,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 10:06:36,711 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemState/d43f59aaac031a68c27179303f2729ab 2023-07-23 10:06:36,712 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemState/4d11cd39dcaa07f628a6adaef0637559 2023-07-23 10:06:36,712 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemState/d43f59aaac031a68c27179303f2729ab empty. 2023-07-23 10:06:36,712 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemState/4d11cd39dcaa07f628a6adaef0637559 empty. 2023-07-23 10:06:36,713 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemState/d43f59aaac031a68c27179303f2729ab 2023-07-23 10:06:36,713 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemState/4d11cd39dcaa07f628a6adaef0637559 2023-07-23 10:06:36,713 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-23 10:06:36,726 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-23 10:06:36,728 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => d43f59aaac031a68c27179303f2729ab, NAME => 'testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp 2023-07-23 10:06:36,728 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4d11cd39dcaa07f628a6adaef0637559, NAME => 'testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp 2023-07-23 10:06:36,740 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:36,741 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing d43f59aaac031a68c27179303f2729ab, disabling compactions & flushes 2023-07-23 10:06:36,741 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. 2023-07-23 10:06:36,741 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. 2023-07-23 10:06:36,741 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. after waiting 0 ms 2023-07-23 10:06:36,741 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. 2023-07-23 10:06:36,741 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. 2023-07-23 10:06:36,741 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for d43f59aaac031a68c27179303f2729ab: 2023-07-23 10:06:36,741 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:36,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 4d11cd39dcaa07f628a6adaef0637559, disabling compactions & flushes 2023-07-23 10:06:36,742 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559. 2023-07-23 10:06:36,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559. 2023-07-23 10:06:36,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559. after waiting 0 ms 2023-07-23 10:06:36,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559. 2023-07-23 10:06:36,742 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559. 2023-07-23 10:06:36,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 4d11cd39dcaa07f628a6adaef0637559: 2023-07-23 10:06:36,745 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 10:06:36,747 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690106796746"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106796746"}]},"ts":"1690106796746"} 2023-07-23 10:06:36,747 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690106796746"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106796746"}]},"ts":"1690106796746"} 2023-07-23 10:06:36,749 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 10:06:36,750 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 10:06:36,751 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106796751"}]},"ts":"1690106796751"} 2023-07-23 10:06:36,752 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-23 10:06:36,761 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 10:06:36,762 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 10:06:36,762 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 10:06:36,762 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 10:06:36,762 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 10:06:36,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d43f59aaac031a68c27179303f2729ab, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4d11cd39dcaa07f628a6adaef0637559, ASSIGN}] 2023-07-23 10:06:36,765 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4d11cd39dcaa07f628a6adaef0637559, ASSIGN 2023-07-23 10:06:36,765 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d43f59aaac031a68c27179303f2729ab, ASSIGN 2023-07-23 10:06:36,766 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4d11cd39dcaa07f628a6adaef0637559, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43301,1690106767667; forceNewPlan=false, retain=false 2023-07-23 10:06:36,766 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d43f59aaac031a68c27179303f2729ab, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35943,1690106767812; forceNewPlan=false, retain=false 2023-07-23 10:06:36,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 10:06:36,916 INFO [jenkins-hbase4:39043] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 10:06:36,919 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4d11cd39dcaa07f628a6adaef0637559, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:36,919 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=d43f59aaac031a68c27179303f2729ab, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:36,919 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690106796919"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106796919"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106796919"}]},"ts":"1690106796919"} 2023-07-23 10:06:36,919 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690106796919"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106796919"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106796919"}]},"ts":"1690106796919"} 2023-07-23 10:06:36,921 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 4d11cd39dcaa07f628a6adaef0637559, server=jenkins-hbase4.apache.org,43301,1690106767667}] 2023-07-23 10:06:36,922 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure d43f59aaac031a68c27179303f2729ab, server=jenkins-hbase4.apache.org,35943,1690106767812}] 2023-07-23 10:06:37,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 10:06:37,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. 2023-07-23 10:06:37,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559. 2023-07-23 10:06:37,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d43f59aaac031a68c27179303f2729ab, NAME => 'testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 10:06:37,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4d11cd39dcaa07f628a6adaef0637559, NAME => 'testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 10:06:37,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. service=AccessControlService 2023-07-23 10:06:37,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:37,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState d43f59aaac031a68c27179303f2729ab 2023-07-23 10:06:37,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559. service=AccessControlService 2023-07-23 10:06:37,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:37,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d43f59aaac031a68c27179303f2729ab 2023-07-23 10:06:37,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d43f59aaac031a68c27179303f2729ab 2023-07-23 10:06:37,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:37,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 4d11cd39dcaa07f628a6adaef0637559 2023-07-23 10:06:37,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:37,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4d11cd39dcaa07f628a6adaef0637559 2023-07-23 10:06:37,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4d11cd39dcaa07f628a6adaef0637559 2023-07-23 10:06:37,084 INFO [StoreOpener-d43f59aaac031a68c27179303f2729ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d43f59aaac031a68c27179303f2729ab 2023-07-23 10:06:37,085 INFO [StoreOpener-4d11cd39dcaa07f628a6adaef0637559-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4d11cd39dcaa07f628a6adaef0637559 2023-07-23 10:06:37,086 DEBUG [StoreOpener-d43f59aaac031a68c27179303f2729ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/d43f59aaac031a68c27179303f2729ab/cf 2023-07-23 10:06:37,086 DEBUG [StoreOpener-d43f59aaac031a68c27179303f2729ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/d43f59aaac031a68c27179303f2729ab/cf 2023-07-23 10:06:37,086 DEBUG [StoreOpener-4d11cd39dcaa07f628a6adaef0637559-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/4d11cd39dcaa07f628a6adaef0637559/cf 2023-07-23 10:06:37,086 DEBUG [StoreOpener-4d11cd39dcaa07f628a6adaef0637559-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/4d11cd39dcaa07f628a6adaef0637559/cf 2023-07-23 10:06:37,086 INFO [StoreOpener-d43f59aaac031a68c27179303f2729ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d43f59aaac031a68c27179303f2729ab columnFamilyName cf 2023-07-23 10:06:37,086 INFO [StoreOpener-4d11cd39dcaa07f628a6adaef0637559-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d11cd39dcaa07f628a6adaef0637559 columnFamilyName cf 2023-07-23 10:06:37,087 INFO [StoreOpener-d43f59aaac031a68c27179303f2729ab-1] regionserver.HStore(310): Store=d43f59aaac031a68c27179303f2729ab/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:37,088 INFO [StoreOpener-4d11cd39dcaa07f628a6adaef0637559-1] regionserver.HStore(310): Store=4d11cd39dcaa07f628a6adaef0637559/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:37,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/4d11cd39dcaa07f628a6adaef0637559 2023-07-23 10:06:37,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/d43f59aaac031a68c27179303f2729ab 2023-07-23 10:06:37,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/4d11cd39dcaa07f628a6adaef0637559 2023-07-23 10:06:37,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/d43f59aaac031a68c27179303f2729ab 2023-07-23 10:06:37,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4d11cd39dcaa07f628a6adaef0637559 2023-07-23 10:06:37,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d43f59aaac031a68c27179303f2729ab 2023-07-23 10:06:37,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/4d11cd39dcaa07f628a6adaef0637559/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:06:37,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/d43f59aaac031a68c27179303f2729ab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:06:37,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4d11cd39dcaa07f628a6adaef0637559; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63416674, jitterRate=-0.05501791834831238}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:06:37,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4d11cd39dcaa07f628a6adaef0637559: 2023-07-23 10:06:37,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d43f59aaac031a68c27179303f2729ab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62899779, jitterRate=-0.06272025406360626}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:06:37,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d43f59aaac031a68c27179303f2729ab: 2023-07-23 10:06:37,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559., pid=30, masterSystemTime=1690106797074 2023-07-23 10:06:37,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab., pid=31, masterSystemTime=1690106797074 2023-07-23 10:06:37,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559. 2023-07-23 10:06:37,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559. 2023-07-23 10:06:37,099 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4d11cd39dcaa07f628a6adaef0637559, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. 2023-07-23 10:06:37,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. 2023-07-23 10:06:37,100 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690106797099"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106797099"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106797099"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106797099"}]},"ts":"1690106797099"} 2023-07-23 10:06:37,100 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=d43f59aaac031a68c27179303f2729ab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,101 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690106797100"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106797100"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106797100"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106797100"}]},"ts":"1690106797100"} 2023-07-23 10:06:37,104 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-23 10:06:37,106 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 4d11cd39dcaa07f628a6adaef0637559, server=jenkins-hbase4.apache.org,43301,1690106767667 in 181 msec 2023-07-23 10:06:37,107 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-23 10:06:37,108 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure d43f59aaac031a68c27179303f2729ab, server=jenkins-hbase4.apache.org,35943,1690106767812 in 181 msec 2023-07-23 10:06:37,109 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4d11cd39dcaa07f628a6adaef0637559, ASSIGN in 344 msec 2023-07-23 10:06:37,110 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-23 10:06:37,110 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d43f59aaac031a68c27179303f2729ab, ASSIGN in 346 msec 2023-07-23 10:06:37,111 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 10:06:37,111 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106797111"}]},"ts":"1690106797111"} 2023-07-23 10:06:37,113 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-23 10:06:37,118 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 10:06:37,118 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-23 10:06:37,120 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 10:06:37,122 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:37,122 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:37,122 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:37,122 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:37,125 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:37,125 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:37,125 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:37,125 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:37,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 421 msec 2023-07-23 10:06:37,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 10:06:37,313 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-23 10:06:37,313 DEBUG [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-23 10:06:37,314 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:06:37,317 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-23 10:06:37,317 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:06:37,317 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-23 10:06:37,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:06:37,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106797321 (current time:1690106797321). 2023-07-23 10:06:37,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:06:37,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x489d76b6 to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:37,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c805702, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:37,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:37,331 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49208, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:37,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x489d76b6 to 127.0.0.1:61286 2023-07-23 10:06:37,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:37,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x08f29176 to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:37,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bf97e18, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:37,342 DEBUG [hconnection-0x35df0422-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:37,345 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:37,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:37,350 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44904, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:37,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08f29176 to 127.0.0.1:61286 2023-07-23 10:06:37,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:37,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 10:06:37,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:06:37,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:06:37,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:06:37,356 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:06:37,357 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690107397357 2023-07-23 10:06:37,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:06:37,357 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-23 10:06:37,358 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:06:37,358 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:06:37,360 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:06:37,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 10:06:37,362 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-23 10:06:37,363 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 10:06:37,363 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690107397363 2023-07-23 10:06:37,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,375 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-23 10:06:37,376 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:37,377 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-23 10:06:37,377 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-23 10:06:37,377 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,377 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,379 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:37,379 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:37,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:37,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:37,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:37,379 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:37,379 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:37,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:37,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:37,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,380 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,380 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,380 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,380 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:06:37,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-23 10:06:37,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-23 10:06:37,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-23 10:06:37,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,381 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 10:06:37,380 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 10:06:37,381 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 10:06:37,381 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,381 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 10:06:37,381 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:37,381 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,382 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 10:06:37,382 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 10:06:37,382 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:37,381 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,383 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 10:06:37,383 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 10:06:37,382 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-23 10:06:37,383 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:37,383 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35943,1690106767812' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-23 10:06:37,383 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-23 10:06:37,384 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44315,1690106767755' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-23 10:06:37,384 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 10:06:37,384 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-23 10:06:37,384 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-23 10:06:37,385 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,385 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:37,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:37,390 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,390 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:37,390 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,391 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:37,390 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,391 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,391 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:37,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:37,391 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,391 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:37,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:37,393 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35943,1690106767812' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-23 10:06:37,393 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f055e75[Count = 1] remaining members to acquire global barrier 2023-07-23 10:06:37,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:37,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:37,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:37,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:37,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:37,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-23 10:06:37,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f055e75[Count = 0] remaining members to acquire global barrier 2023-07-23 10:06:37,395 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 10:06:37,396 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,397 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,397 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,397 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,397 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,397 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:06:37,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,397 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:06:37,397 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,397 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:06:37,397 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559. 2023-07-23 10:06:37,397 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:37,398 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:37,398 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. 2023-07-23 10:06:37,397 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:06:37,398 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. started... 2023-07-23 10:06:37,397 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559. started... 2023-07-23 10:06:37,397 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:37,398 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-23 10:06:37,399 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44315,1690106767755' in zk 2023-07-23 10:06:37,398 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:37,399 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4d11cd39dcaa07f628a6adaef0637559: 2023-07-23 10:06:37,399 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d43f59aaac031a68c27179303f2729ab: 2023-07-23 10:06:37,399 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,399 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,399 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:37,399 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:37,399 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:06:37,399 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:06:37,400 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 10:06:37,400 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:37,400 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-23 10:06:37,422 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. completed. 2023-07-23 10:06:37,422 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. 2023-07-23 10:06:37,422 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:37,422 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:37,422 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,422 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-23 10:06:37,422 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35943,1690106767812' in zk 2023-07-23 10:06:37,422 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559. completed. 2023-07-23 10:06:37,422 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559. 2023-07-23 10:06:37,422 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:37,423 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:37,423 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,423 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-23 10:06:37,423 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43301,1690106767667' in zk 2023-07-23 10:06:37,424 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,424 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 10:06:37,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:37,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:37,424 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:37,424 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-23 10:06:37,426 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,426 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 10:06:37,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:37,426 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:37,426 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-23 10:06:37,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:37,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:37,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35943,1690106767812': 2023-07-23 10:06:37,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35943,1690106767812' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 10:06:37,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:37,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:37,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:37,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:37,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:37,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43301,1690106767667': 2023-07-23 10:06:37,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 10:06:37,436 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-23 10:06:37,436 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:06:37,436 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:06:37,436 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,436 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:06:37,438 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,438 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,438 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,438 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:37,438 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,438 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:37,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:37,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:37,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,439 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,438 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:37,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:37,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:37,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:37,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:37,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:37,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,440 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,441 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:37,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:37,443 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,443 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,443 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,446 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,446 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,446 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:37,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:37,446 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:37,447 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:37,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:37,447 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,446 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:37,447 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:37,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:37,447 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:37,447 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,447 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:37,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:37,447 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:37,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:37,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:37,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:37,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:37,448 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,447 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,449 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,449 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:37,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:37,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:37,449 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,449 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,449 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,449 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,458 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:37,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 10:06:37,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:06:37,460 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:06:37,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,499 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-23 10:06:37,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,499 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:37,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690106797357Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1690106797449 (+92 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1690106797449Writing data manifest for emptySnaptb0-testExportFileSystemState at 1690106797453 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1690106797467 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690106797499 (+32 ms) 2023-07-23 10:06:37,502 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 10:06:37,504 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 144 msec 2023-07-23 10:06:37,660 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:37,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 10:06:37,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:06:37,670 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:37,675 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60944, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:37,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43301] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:06:37,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35943] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:06:37,680 DEBUG [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-23 10:06:37,680 DEBUG [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. 2023-07-23 10:06:37,681 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:06:37,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:06:37,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106797693 (current time:1690106797693). 2023-07-23 10:06:37,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:06:37,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x4b3aa5a4 to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:37,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1cf163be, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:37,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:37,703 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49220, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:37,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b3aa5a4 to 127.0.0.1:61286 2023-07-23 10:06:37,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:37,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x381c5856 to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:37,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9cb7b8a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:37,714 DEBUG [hconnection-0x1f2e832e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:37,715 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:37,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:37,720 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44906, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:37,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x381c5856 to 127.0.0.1:61286 2023-07-23 10:06:37,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:37,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 10:06:37,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:06:37,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:06:37,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:06:37,726 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:06:37,727 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690107397727 2023-07-23 10:06:37,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:06:37,727 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-23 10:06:37,728 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:06:37,728 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:06:37,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 10:06:37,729 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:06:37,731 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-23 10:06:37,732 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 10:06:37,732 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690107397732 2023-07-23 10:06:37,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-23 10:06:37,743 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-23 10:06:37,743 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:37,745 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-23 10:06:37,745 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-23 10:06:37,745 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,745 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,746 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:37,747 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:37,747 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:37,746 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:37,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:37,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:37,747 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,747 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,747 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,748 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:06:37,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,748 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,748 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-23 10:06:37,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,748 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 10:06:37,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-23 10:06:37,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-23 10:06:37,748 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-23 10:06:37,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,748 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 10:06:37,749 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:37,748 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 10:06:37,749 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 10:06:37,749 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 10:06:37,750 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-23 10:06:37,750 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44315,1690106767755' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-23 10:06:37,750 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-23 10:06:37,750 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-23 10:06:37,750 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 10:06:37,750 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 10:06:37,750 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:37,750 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:37,751 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 10:06:37,752 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-23 10:06:37,752 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 10:06:37,752 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-23 10:06:37,752 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-23 10:06:37,752 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35943,1690106767812' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-23 10:06:37,754 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,755 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,755 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:37,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:37,756 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,756 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,756 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:37,756 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:37,756 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,756 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:37,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:37,756 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,756 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:37,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 10:06:37,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:37,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-23 10:06:37,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76f72923[Count = 1] remaining members to acquire global barrier 2023-07-23 10:06:37,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:37,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:37,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:37,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:37,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 10:06:37,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:37,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35943,1690106767812' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-23 10:06:37,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76f72923[Count = 0] remaining members to acquire global barrier 2023-07-23 10:06:37,760 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 10:06:37,760 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,761 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,761 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,762 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,762 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,762 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:06:37,762 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:06:37,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,762 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:06:37,762 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:37,762 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:37,762 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,762 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559. 2023-07-23 10:06:37,762 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:37,762 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559. started... 2023-07-23 10:06:37,762 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. 2023-07-23 10:06:37,762 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:37,762 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-23 10:06:37,763 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4d11cd39dcaa07f628a6adaef0637559 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-23 10:06:37,763 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44315,1690106767755' in zk 2023-07-23 10:06:37,762 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. started... 2023-07-23 10:06:37,762 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:06:37,763 INFO [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d43f59aaac031a68c27179303f2729ab 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-23 10:06:37,765 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 10:06:37,765 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:37,765 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-23 10:06:37,785 INFO [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/d43f59aaac031a68c27179303f2729ab/.tmp/cf/97c310a3c20048b9a40e559db550f902 2023-07-23 10:06:37,786 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/4d11cd39dcaa07f628a6adaef0637559/.tmp/cf/a35a5336b4b74abeb006859dad71664f 2023-07-23 10:06:37,796 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/4d11cd39dcaa07f628a6adaef0637559/.tmp/cf/a35a5336b4b74abeb006859dad71664f as hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/4d11cd39dcaa07f628a6adaef0637559/cf/a35a5336b4b74abeb006859dad71664f 2023-07-23 10:06:37,802 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/4d11cd39dcaa07f628a6adaef0637559/cf/a35a5336b4b74abeb006859dad71664f, entries=45, sequenceid=6, filesize=7.9 K 2023-07-23 10:06:37,803 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/d43f59aaac031a68c27179303f2729ab/.tmp/cf/97c310a3c20048b9a40e559db550f902 as hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/d43f59aaac031a68c27179303f2729ab/cf/97c310a3c20048b9a40e559db550f902 2023-07-23 10:06:37,804 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 4d11cd39dcaa07f628a6adaef0637559 in 40ms, sequenceid=6, compaction requested=false 2023-07-23 10:06:37,805 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-23 10:06:37,805 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4d11cd39dcaa07f628a6adaef0637559: 2023-07-23 10:06:37,806 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-23 10:06:37,806 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:37,806 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/4d11cd39dcaa07f628a6adaef0637559/cf/a35a5336b4b74abeb006859dad71664f] hfiles 2023-07-23 10:06:37,806 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/4d11cd39dcaa07f628a6adaef0637559/cf/a35a5336b4b74abeb006859dad71664f for snapshot=snaptb0-testExportFileSystemState 2023-07-23 10:06:37,812 INFO [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/d43f59aaac031a68c27179303f2729ab/cf/97c310a3c20048b9a40e559db550f902, entries=5, sequenceid=6, filesize=5.2 K 2023-07-23 10:06:37,814 INFO [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for d43f59aaac031a68c27179303f2729ab in 51ms, sequenceid=6, compaction requested=false 2023-07-23 10:06:37,815 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d43f59aaac031a68c27179303f2729ab: 2023-07-23 10:06:37,815 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-23 10:06:37,815 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:37,815 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/d43f59aaac031a68c27179303f2729ab/cf/97c310a3c20048b9a40e559db550f902] hfiles 2023-07-23 10:06:37,815 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/d43f59aaac031a68c27179303f2729ab/cf/97c310a3c20048b9a40e559db550f902 for snapshot=snaptb0-testExportFileSystemState 2023-07-23 10:06:37,821 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559. completed. 2023-07-23 10:06:37,821 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559. 2023-07-23 10:06:37,821 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:37,821 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:37,821 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,821 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-23 10:06:37,821 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43301,1690106767667' in zk 2023-07-23 10:06:37,825 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 10:06:37,825 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,825 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:37,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:37,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:37,825 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. completed. 2023-07-23 10:06:37,826 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-23 10:06:37,827 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. 2023-07-23 10:06:37,827 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:37,827 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:37,827 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,827 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-23 10:06:37,827 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35943,1690106767812' in zk 2023-07-23 10:06:37,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:37,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:37,828 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:37,829 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 10:06:37,829 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 10:06:37,829 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:37,829 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-23 10:06:37,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 10:06:37,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:06:37,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,830 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:06:37,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:37,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 10:06:37,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43301,1690106767667': 2023-07-23 10:06:37,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 10:06:37,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:37,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:37,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:37,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:37,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 10:06:37,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:37,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 10:06:37,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35943,1690106767812': 2023-07-23 10:06:37,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35943,1690106767812' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 10:06:37,836 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-23 10:06:37,836 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:06:37,836 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:06:37,836 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-23 10:06:37,836 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:06:37,838 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,838 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,839 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,838 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:37,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,839 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:37,839 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:37,839 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:37,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,839 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:37,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:37,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:37,839 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:37,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:37,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:37,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:37,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:37,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,840 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 10:06:37,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:37,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 10:06:37,842 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,842 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,843 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:37,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 10:06:37,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,847 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:37,847 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:37,847 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:37,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:37,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:37,847 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,847 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,847 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:37,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:37,847 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-23 10:06:37,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-23 10:06:37,847 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,847 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:37,848 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,848 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,849 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:37,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:37,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:37,847 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:37,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:37,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:37,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:37,849 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:37,849 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState because node does not exist (not an error) 2023-07-23 10:06:37,849 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,850 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:37,850 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:37,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,850 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:37,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:37,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:37,850 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:37,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,897 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-23 10:06:37,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,898 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 10:06:37,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690106797727Consolidate snapshot: snaptb0-testExportFileSystemState at 1690106797847 (+120 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1690106797848 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1690106797853 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1690106797865 (+12 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690106797897 (+32 ms) 2023-07-23 10:06:37,900 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 10:06:37,902 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 172 msec 2023-07-23 10:06:38,031 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:38,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 10:06:38,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:06:38,036 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106798036 2023-07-23 10:06:38,036 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39321, tgtDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106798036, rawTgtDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106798036, srcFsUri=hdfs://localhost:39321, srcDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa 2023-07-23 10:06:38,064 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39321, inputRoot=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa 2023-07-23 10:06:38,064 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_167426604_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106798036, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106798036/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 10:06:38,064 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39321, inputRoot=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa, snapshotDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-23 10:06:38,077 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106798036/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 10:06:38,107 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:38,108 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:38,108 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:38,109 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:38,109 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:38,110 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:38,110 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:38,190 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/hadoop-4676639297367793451.jar 2023-07-23 10:06:38,191 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:38,191 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:38,192 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:38,192 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:38,192 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:38,193 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:38,193 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 10:06:38,194 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 10:06:38,194 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 10:06:38,194 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 10:06:38,195 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 10:06:38,195 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 10:06:38,196 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 10:06:38,196 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 10:06:38,196 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 10:06:38,197 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 10:06:38,197 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:38,198 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:38,199 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:06:38,199 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:38,199 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:38,200 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:06:38,200 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:06:38,609 WARN [Listener at jenkins-hbase4.apache.org/44999] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 10:06:38,612 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-23 10:06:38,614 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-23 10:06:40,450 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:06:40,451 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:06:40,457 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0001_000001 (auth:SIMPLE) 2023-07-23 10:06:41,192 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0002_000001 (auth:SIMPLE) 2023-07-23 10:06:42,005 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 10:06:45,759 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0002_000001 (auth:SIMPLE) 2023-07-23 10:06:48,017 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0002_000001 (auth:SIMPLE) 2023-07-23 10:06:50,557 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0002_000001 (auth:SIMPLE) 2023-07-23 10:06:51,810 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 10:06:51,811 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 10:06:51,818 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-23 10:06:51,818 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 10:06:51,819 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 10:06:51,819 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-372295689_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-23 10:06:51,820 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-23 10:06:51,820 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-23 10:06:51,820 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-372295689_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106798036/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106798036/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-23 10:06:51,820 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106798036/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-23 10:06:51,820 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106798036/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-23 10:06:51,830 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-23 10:06:51,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-23 10:06:51,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-23 10:06:51,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-23 10:06:51,836 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106811836"}]},"ts":"1690106811836"} 2023-07-23 10:06:51,838 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-23 10:06:51,840 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-23 10:06:51,841 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d43f59aaac031a68c27179303f2729ab, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4d11cd39dcaa07f628a6adaef0637559, UNASSIGN}] 2023-07-23 10:06:51,844 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4d11cd39dcaa07f628a6adaef0637559, UNASSIGN 2023-07-23 10:06:51,844 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d43f59aaac031a68c27179303f2729ab, UNASSIGN 2023-07-23 10:06:51,845 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=4d11cd39dcaa07f628a6adaef0637559, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:51,845 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690106811845"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106811845"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106811845"}]},"ts":"1690106811845"} 2023-07-23 10:06:51,845 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=d43f59aaac031a68c27179303f2729ab, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:51,845 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690106811845"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106811845"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106811845"}]},"ts":"1690106811845"} 2023-07-23 10:06:51,847 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 4d11cd39dcaa07f628a6adaef0637559, server=jenkins-hbase4.apache.org,43301,1690106767667}] 2023-07-23 10:06:51,848 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure d43f59aaac031a68c27179303f2729ab, server=jenkins-hbase4.apache.org,35943,1690106767812}] 2023-07-23 10:06:51,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-23 10:06:52,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4d11cd39dcaa07f628a6adaef0637559 2023-07-23 10:06:52,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4d11cd39dcaa07f628a6adaef0637559, disabling compactions & flushes 2023-07-23 10:06:52,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559. 2023-07-23 10:06:52,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559. 2023-07-23 10:06:52,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559. after waiting 0 ms 2023-07-23 10:06:52,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559. 2023-07-23 10:06:52,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d43f59aaac031a68c27179303f2729ab 2023-07-23 10:06:52,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d43f59aaac031a68c27179303f2729ab, disabling compactions & flushes 2023-07-23 10:06:52,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. 2023-07-23 10:06:52,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. 2023-07-23 10:06:52,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. after waiting 0 ms 2023-07-23 10:06:52,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. 2023-07-23 10:06:52,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/4d11cd39dcaa07f628a6adaef0637559/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:06:52,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:06:52,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559. 2023-07-23 10:06:52,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4d11cd39dcaa07f628a6adaef0637559: 2023-07-23 10:06:52,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemState/d43f59aaac031a68c27179303f2729ab/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:06:52,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:06:52,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab. 2023-07-23 10:06:52,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d43f59aaac031a68c27179303f2729ab: 2023-07-23 10:06:52,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4d11cd39dcaa07f628a6adaef0637559 2023-07-23 10:06:52,028 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=4d11cd39dcaa07f628a6adaef0637559, regionState=CLOSED 2023-07-23 10:06:52,029 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690106812028"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106812028"}]},"ts":"1690106812028"} 2023-07-23 10:06:52,030 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d43f59aaac031a68c27179303f2729ab 2023-07-23 10:06:52,030 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=d43f59aaac031a68c27179303f2729ab, regionState=CLOSED 2023-07-23 10:06:52,030 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690106812030"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106812030"}]},"ts":"1690106812030"} 2023-07-23 10:06:52,035 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-23 10:06:52,035 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 4d11cd39dcaa07f628a6adaef0637559, server=jenkins-hbase4.apache.org,43301,1690106767667 in 183 msec 2023-07-23 10:06:52,037 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-23 10:06:52,037 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4d11cd39dcaa07f628a6adaef0637559, UNASSIGN in 194 msec 2023-07-23 10:06:52,037 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure d43f59aaac031a68c27179303f2729ab, server=jenkins-hbase4.apache.org,35943,1690106767812 in 184 msec 2023-07-23 10:06:52,042 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-23 10:06:52,042 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d43f59aaac031a68c27179303f2729ab, UNASSIGN in 196 msec 2023-07-23 10:06:52,043 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106812043"}]},"ts":"1690106812043"} 2023-07-23 10:06:52,044 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-23 10:06:52,046 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-23 10:06:52,050 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 216 msec 2023-07-23 10:06:52,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-23 10:06:52,138 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-23 10:06:52,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-23 10:06:52,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 10:06:52,143 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 10:06:52,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-23 10:06:52,144 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 10:06:52,145 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-23 10:06:52,149 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 10:06:52,149 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 10:06:52,149 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 10:06:52,149 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemState/d43f59aaac031a68c27179303f2729ab 2023-07-23 10:06:52,149 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemState/4d11cd39dcaa07f628a6adaef0637559 2023-07-23 10:06:52,149 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 10:06:52,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 10:06:52,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 10:06:52,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 10:06:52,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 10:06:52,151 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 10:06:52,151 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:52,151 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 10:06:52,151 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 10:06:52,151 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:52,151 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:52,152 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 10:06:52,152 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:52,152 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemState/d43f59aaac031a68c27179303f2729ab/cf, FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemState/d43f59aaac031a68c27179303f2729ab/recovered.edits] 2023-07-23 10:06:52,152 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemState/4d11cd39dcaa07f628a6adaef0637559/cf, FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemState/4d11cd39dcaa07f628a6adaef0637559/recovered.edits] 2023-07-23 10:06:52,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-23 10:06:52,157 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemState/d43f59aaac031a68c27179303f2729ab/cf/97c310a3c20048b9a40e559db550f902 to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testExportFileSystemState/d43f59aaac031a68c27179303f2729ab/cf/97c310a3c20048b9a40e559db550f902 2023-07-23 10:06:52,157 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemState/4d11cd39dcaa07f628a6adaef0637559/cf/a35a5336b4b74abeb006859dad71664f to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testExportFileSystemState/4d11cd39dcaa07f628a6adaef0637559/cf/a35a5336b4b74abeb006859dad71664f 2023-07-23 10:06:52,161 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemState/d43f59aaac031a68c27179303f2729ab/recovered.edits/9.seqid to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testExportFileSystemState/d43f59aaac031a68c27179303f2729ab/recovered.edits/9.seqid 2023-07-23 10:06:52,161 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemState/4d11cd39dcaa07f628a6adaef0637559/recovered.edits/9.seqid to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testExportFileSystemState/4d11cd39dcaa07f628a6adaef0637559/recovered.edits/9.seqid 2023-07-23 10:06:52,163 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemState/d43f59aaac031a68c27179303f2729ab 2023-07-23 10:06:52,163 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemState/4d11cd39dcaa07f628a6adaef0637559 2023-07-23 10:06:52,163 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-23 10:06:52,166 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 10:06:52,168 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-23 10:06:52,170 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-23 10:06:52,172 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 10:06:52,172 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-23 10:06:52,172 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106812172"}]},"ts":"9223372036854775807"} 2023-07-23 10:06:52,172 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106812172"}]},"ts":"9223372036854775807"} 2023-07-23 10:06:52,175 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 10:06:52,176 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d43f59aaac031a68c27179303f2729ab, NAME => 'testtb-testExportFileSystemState,,1690106796703.d43f59aaac031a68c27179303f2729ab.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4d11cd39dcaa07f628a6adaef0637559, NAME => 'testtb-testExportFileSystemState,1,1690106796703.4d11cd39dcaa07f628a6adaef0637559.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 10:06:52,176 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-23 10:06:52,176 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690106812176"}]},"ts":"9223372036854775807"} 2023-07-23 10:06:52,177 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-23 10:06:52,179 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 10:06:52,181 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 40 msec 2023-07-23 10:06:52,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-23 10:06:52,255 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-23 10:06:52,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-23 10:06:52,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:52,267 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-23 10:06:52,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-23 10:06:52,298 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=770 (was 758) Potentially hanging thread: hconnection-0x5a736194-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-372295689_17 at /127.0.0.1:44832 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a736194-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-372295689_17 at /127.0.0.1:58748 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_289669294_1 at /127.0.0.1:58722 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-372295689_17 at /127.0.0.1:55138 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:34681 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_289669294_1 at /127.0.0.1:44808 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2068 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a736194-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a736194-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=929 (was 936), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=260 (was 279), ProcessCount=179 (was 179), AvailableMemoryMB=6451 (was 6498) 2023-07-23 10:06:52,298 WARN [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(130): Thread=770 is superior to 500 2023-07-23 10:06:52,321 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=770, OpenFileDescriptor=929, MaxFileDescriptor=60000, SystemLoadAverage=260, ProcessCount=179, AvailableMemoryMB=6450 2023-07-23 10:06:52,321 WARN [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(130): Thread=770 is superior to 500 2023-07-23 10:06:52,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 10:06:52,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-23 10:06:52,327 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 10:06:52,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-23 10:06:52,328 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 10:06:52,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 10:06:52,331 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testConsecutiveExports/8d2efd932fbadd58477acd79fe8ddc32 2023-07-23 10:06:52,331 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testConsecutiveExports/11e7b7d4fe071b96d3274fe00a0d827d 2023-07-23 10:06:52,331 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testConsecutiveExports/8d2efd932fbadd58477acd79fe8ddc32 empty. 2023-07-23 10:06:52,331 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testConsecutiveExports/11e7b7d4fe071b96d3274fe00a0d827d empty. 2023-07-23 10:06:52,332 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testConsecutiveExports/8d2efd932fbadd58477acd79fe8ddc32 2023-07-23 10:06:52,332 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testConsecutiveExports/11e7b7d4fe071b96d3274fe00a0d827d 2023-07-23 10:06:52,332 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-23 10:06:52,349 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-23 10:06:52,351 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 11e7b7d4fe071b96d3274fe00a0d827d, NAME => 'testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp 2023-07-23 10:06:52,351 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8d2efd932fbadd58477acd79fe8ddc32, NAME => 'testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp 2023-07-23 10:06:52,391 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:52,392 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:52,392 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 8d2efd932fbadd58477acd79fe8ddc32, disabling compactions & flushes 2023-07-23 10:06:52,392 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 11e7b7d4fe071b96d3274fe00a0d827d, disabling compactions & flushes 2023-07-23 10:06:52,392 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. 2023-07-23 10:06:52,392 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d. 2023-07-23 10:06:52,392 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. 2023-07-23 10:06:52,392 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d. 2023-07-23 10:06:52,392 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. after waiting 0 ms 2023-07-23 10:06:52,392 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d. after waiting 0 ms 2023-07-23 10:06:52,392 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. 2023-07-23 10:06:52,392 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d. 2023-07-23 10:06:52,392 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. 2023-07-23 10:06:52,392 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d. 2023-07-23 10:06:52,392 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 8d2efd932fbadd58477acd79fe8ddc32: 2023-07-23 10:06:52,392 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 11e7b7d4fe071b96d3274fe00a0d827d: 2023-07-23 10:06:52,397 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 10:06:52,398 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690106812398"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106812398"}]},"ts":"1690106812398"} 2023-07-23 10:06:52,398 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690106812398"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106812398"}]},"ts":"1690106812398"} 2023-07-23 10:06:52,401 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 10:06:52,402 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 10:06:52,403 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106812403"}]},"ts":"1690106812403"} 2023-07-23 10:06:52,405 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-23 10:06:52,409 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 10:06:52,411 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 10:06:52,411 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 10:06:52,412 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 10:06:52,412 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 10:06:52,412 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8d2efd932fbadd58477acd79fe8ddc32, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=11e7b7d4fe071b96d3274fe00a0d827d, ASSIGN}] 2023-07-23 10:06:52,415 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8d2efd932fbadd58477acd79fe8ddc32, ASSIGN 2023-07-23 10:06:52,415 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=11e7b7d4fe071b96d3274fe00a0d827d, ASSIGN 2023-07-23 10:06:52,416 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8d2efd932fbadd58477acd79fe8ddc32, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43301,1690106767667; forceNewPlan=false, retain=false 2023-07-23 10:06:52,416 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=11e7b7d4fe071b96d3274fe00a0d827d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44315,1690106767755; forceNewPlan=false, retain=false 2023-07-23 10:06:52,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 10:06:52,566 INFO [jenkins-hbase4:39043] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 10:06:52,569 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=8d2efd932fbadd58477acd79fe8ddc32, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:52,570 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=11e7b7d4fe071b96d3274fe00a0d827d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:52,570 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690106812569"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106812569"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106812569"}]},"ts":"1690106812569"} 2023-07-23 10:06:52,570 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690106812569"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106812569"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106812569"}]},"ts":"1690106812569"} 2023-07-23 10:06:52,572 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 8d2efd932fbadd58477acd79fe8ddc32, server=jenkins-hbase4.apache.org,43301,1690106767667}] 2023-07-23 10:06:52,573 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 11e7b7d4fe071b96d3274fe00a0d827d, server=jenkins-hbase4.apache.org,44315,1690106767755}] 2023-07-23 10:06:52,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 10:06:52,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d. 2023-07-23 10:06:52,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. 2023-07-23 10:06:52,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 11e7b7d4fe071b96d3274fe00a0d827d, NAME => 'testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 10:06:52,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8d2efd932fbadd58477acd79fe8ddc32, NAME => 'testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 10:06:52,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d. service=AccessControlService 2023-07-23 10:06:52,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. service=AccessControlService 2023-07-23 10:06:52,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:52,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:52,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 11e7b7d4fe071b96d3274fe00a0d827d 2023-07-23 10:06:52,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 8d2efd932fbadd58477acd79fe8ddc32 2023-07-23 10:06:52,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:52,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:52,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 11e7b7d4fe071b96d3274fe00a0d827d 2023-07-23 10:06:52,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 11e7b7d4fe071b96d3274fe00a0d827d 2023-07-23 10:06:52,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8d2efd932fbadd58477acd79fe8ddc32 2023-07-23 10:06:52,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8d2efd932fbadd58477acd79fe8ddc32 2023-07-23 10:06:52,740 INFO [StoreOpener-8d2efd932fbadd58477acd79fe8ddc32-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8d2efd932fbadd58477acd79fe8ddc32 2023-07-23 10:06:52,740 INFO [StoreOpener-11e7b7d4fe071b96d3274fe00a0d827d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 11e7b7d4fe071b96d3274fe00a0d827d 2023-07-23 10:06:52,742 DEBUG [StoreOpener-8d2efd932fbadd58477acd79fe8ddc32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/8d2efd932fbadd58477acd79fe8ddc32/cf 2023-07-23 10:06:52,742 DEBUG [StoreOpener-11e7b7d4fe071b96d3274fe00a0d827d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/11e7b7d4fe071b96d3274fe00a0d827d/cf 2023-07-23 10:06:52,742 DEBUG [StoreOpener-8d2efd932fbadd58477acd79fe8ddc32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/8d2efd932fbadd58477acd79fe8ddc32/cf 2023-07-23 10:06:52,742 DEBUG [StoreOpener-11e7b7d4fe071b96d3274fe00a0d827d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/11e7b7d4fe071b96d3274fe00a0d827d/cf 2023-07-23 10:06:52,743 INFO [StoreOpener-11e7b7d4fe071b96d3274fe00a0d827d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 11e7b7d4fe071b96d3274fe00a0d827d columnFamilyName cf 2023-07-23 10:06:52,743 INFO [StoreOpener-8d2efd932fbadd58477acd79fe8ddc32-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d2efd932fbadd58477acd79fe8ddc32 columnFamilyName cf 2023-07-23 10:06:52,743 INFO [StoreOpener-8d2efd932fbadd58477acd79fe8ddc32-1] regionserver.HStore(310): Store=8d2efd932fbadd58477acd79fe8ddc32/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:52,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/8d2efd932fbadd58477acd79fe8ddc32 2023-07-23 10:06:52,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/8d2efd932fbadd58477acd79fe8ddc32 2023-07-23 10:06:52,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8d2efd932fbadd58477acd79fe8ddc32 2023-07-23 10:06:52,751 INFO [StoreOpener-11e7b7d4fe071b96d3274fe00a0d827d-1] regionserver.HStore(310): Store=11e7b7d4fe071b96d3274fe00a0d827d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:52,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/8d2efd932fbadd58477acd79fe8ddc32/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:06:52,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8d2efd932fbadd58477acd79fe8ddc32; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62082367, jitterRate=-0.07490064203739166}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:06:52,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/11e7b7d4fe071b96d3274fe00a0d827d 2023-07-23 10:06:52,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8d2efd932fbadd58477acd79fe8ddc32: 2023-07-23 10:06:52,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/11e7b7d4fe071b96d3274fe00a0d827d 2023-07-23 10:06:52,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32., pid=45, masterSystemTime=1690106812730 2023-07-23 10:06:52,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. 2023-07-23 10:06:52,754 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. 2023-07-23 10:06:52,755 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=8d2efd932fbadd58477acd79fe8ddc32, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:52,755 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690106812755"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106812755"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106812755"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106812755"}]},"ts":"1690106812755"} 2023-07-23 10:06:52,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 11e7b7d4fe071b96d3274fe00a0d827d 2023-07-23 10:06:52,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/11e7b7d4fe071b96d3274fe00a0d827d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:06:52,759 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-23 10:06:52,759 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 8d2efd932fbadd58477acd79fe8ddc32, server=jenkins-hbase4.apache.org,43301,1690106767667 in 185 msec 2023-07-23 10:06:52,759 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 11e7b7d4fe071b96d3274fe00a0d827d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74979616, jitterRate=0.11728334426879883}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:06:52,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 11e7b7d4fe071b96d3274fe00a0d827d: 2023-07-23 10:06:52,760 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d., pid=46, masterSystemTime=1690106812730 2023-07-23 10:06:52,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8d2efd932fbadd58477acd79fe8ddc32, ASSIGN in 347 msec 2023-07-23 10:06:52,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d. 2023-07-23 10:06:52,761 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d. 2023-07-23 10:06:52,762 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=11e7b7d4fe071b96d3274fe00a0d827d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:52,762 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690106812762"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106812762"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106812762"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106812762"}]},"ts":"1690106812762"} 2023-07-23 10:06:52,766 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-23 10:06:52,766 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 11e7b7d4fe071b96d3274fe00a0d827d, server=jenkins-hbase4.apache.org,44315,1690106767755 in 191 msec 2023-07-23 10:06:52,768 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-23 10:06:52,768 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=11e7b7d4fe071b96d3274fe00a0d827d, ASSIGN in 354 msec 2023-07-23 10:06:52,769 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 10:06:52,769 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106812769"}]},"ts":"1690106812769"} 2023-07-23 10:06:52,771 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-23 10:06:52,780 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 10:06:52,780 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-23 10:06:52,783 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-23 10:06:52,785 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:52,785 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:52,785 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:52,785 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:52,787 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 10:06:52,787 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 10:06:52,787 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:52,787 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:52,787 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:52,788 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:52,790 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 464 msec 2023-07-23 10:06:52,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 10:06:52,933 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-23 10:06:52,933 DEBUG [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-23 10:06:52,933 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:06:52,937 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-23 10:06:52,937 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:06:52,937 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-23 10:06:52,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 10:06:52,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106812940 (current time:1690106812940). 2023-07-23 10:06:52,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:06:52,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x517fc069 to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:52,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22bfb373, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:52,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:52,953 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52660, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:52,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x517fc069 to 127.0.0.1:61286 2023-07-23 10:06:52,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:52,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x016adb05 to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:52,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2eb93fc9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:52,961 DEBUG [hconnection-0x71c23546-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:52,963 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52668, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:52,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:52,969 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:52,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x016adb05 to 127.0.0.1:61286 2023-07-23 10:06:52,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:52,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-23 10:06:52,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:06:52,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 10:06:52,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 10:06:52,974 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 10:06:52,975 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690107412975 2023-07-23 10:06:52,975 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-23 10:06:52,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 10:06:52,977 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:06:52,977 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:06:52,978 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 10:06:52,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 10:06:52,979 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-23 10:06:52,980 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 10:06:52,981 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690107412981 2023-07-23 10:06:53,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,002 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-23 10:06:53,002 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:53,003 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-23 10:06:53,003 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-23 10:06:53,003 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,003 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,009 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:53,009 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:53,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:53,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:53,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:53,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:53,009 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,009 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:53,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:53,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:53,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,010 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,010 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,010 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,010 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:06:53,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-23 10:06:53,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-23 10:06:53,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-23 10:06:53,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,011 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 10:06:53,011 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 10:06:53,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,011 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 10:06:53,012 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,012 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,012 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 10:06:53,012 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 10:06:53,012 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,012 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:53,013 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 10:06:53,013 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:53,012 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:53,014 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 10:06:53,017 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-23 10:06:53,013 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 10:06:53,017 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44315,1690106767755' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-23 10:06:53,017 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-23 10:06:53,017 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 10:06:53,017 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-23 10:06:53,017 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-23 10:06:53,017 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35943,1690106767812' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-23 10:06:53,019 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,019 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:53,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:53,020 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,020 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,020 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,020 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,020 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:53,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:53,020 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,020 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,020 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:53,020 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:53,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:53,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:53,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44315,1690106767755' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-23 10:06:53,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b1c9966[Count = 1] remaining members to acquire global barrier 2023-07-23 10:06:53,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:53,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:53,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:53,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:53,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:53,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-23 10:06:53,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b1c9966[Count = 0] remaining members to acquire global barrier 2023-07-23 10:06:53,024 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-23 10:06:53,024 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,025 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,025 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,025 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,026 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 10:06:53,026 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,026 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-23 10:06:53,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,026 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35943,1690106767812' in zk 2023-07-23 10:06:53,026 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 10:06:53,026 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 10:06:53,026 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,026 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:06:53,026 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:53,026 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:53,026 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d. 2023-07-23 10:06:53,026 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:53,027 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:53,026 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. 2023-07-23 10:06:53,027 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d. started... 2023-07-23 10:06:53,027 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. started... 2023-07-23 10:06:53,028 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 11e7b7d4fe071b96d3274fe00a0d827d: 2023-07-23 10:06:53,028 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8d2efd932fbadd58477acd79fe8ddc32: 2023-07-23 10:06:53,028 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,028 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:53,028 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,028 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:06:53,028 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:53,028 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:06:53,037 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 10:06:53,037 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:53,037 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-23 10:06:53,049 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d. completed. 2023-07-23 10:06:53,049 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d. 2023-07-23 10:06:53,050 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:53,050 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:53,050 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,050 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-23 10:06:53,050 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44315,1690106767755' in zk 2023-07-23 10:06:53,051 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 10:06:53,051 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,052 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:53,052 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-23 10:06:53,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:53,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:53,053 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. completed. 2023-07-23 10:06:53,053 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. 2023-07-23 10:06:53,053 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:53,053 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:53,053 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,053 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-23 10:06:53,053 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43301,1690106767667' in zk 2023-07-23 10:06:53,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:53,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:53,055 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,055 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 10:06:53,055 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:53,055 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-23 10:06:53,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:53,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44315,1690106767755': 2023-07-23 10:06:53,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44315,1690106767755' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-23 10:06:53,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:53,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:53,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:53,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:53,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:53,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43301,1690106767667': 2023-07-23 10:06:53,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-23 10:06:53,063 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-23 10:06:53,063 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:06:53,063 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:06:53,063 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,063 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:06:53,064 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,064 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,064 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,065 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:53,065 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,065 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:53,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:53,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:53,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:53,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,065 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,065 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:53,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:53,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:53,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:53,066 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:53,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:53,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:53,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,067 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:53,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,069 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,069 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:53,070 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,074 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,074 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:53,074 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:53,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:53,074 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:53,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:53,074 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:53,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:53,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:53,074 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,074 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:53,074 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:53,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:53,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:53,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:53,074 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,074 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:53,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:53,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:53,074 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,074 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:53,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:53,075 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:53,076 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,076 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,076 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,076 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,076 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,076 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,077 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:53,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 10:06:53,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:06:53,078 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:06:53,093 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,112 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-23 10:06:53,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,113 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:53,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690106812975Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1690106813075 (+100 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1690106813076 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1690106813080 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1690106813088 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690106813112 (+24 ms) 2023-07-23 10:06:53,115 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 10:06:53,117 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 139 msec 2023-07-23 10:06:53,278 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:53,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 10:06:53,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:06:53,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43301] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:06:53,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44315] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:06:53,290 DEBUG [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-23 10:06:53,290 DEBUG [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. 2023-07-23 10:06:53,292 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:06:53,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 10:06:53,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106813303 (current time:1690106813303). 2023-07-23 10:06:53,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:06:53,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x62dd5179 to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:53,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7273f615, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:53,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:53,316 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52682, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:53,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62dd5179 to 127.0.0.1:61286 2023-07-23 10:06:53,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:53,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x51dd2d24 to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:53,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5983e8ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:53,324 DEBUG [hconnection-0x34ad7e84-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:53,327 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52686, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:53,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:53,331 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55582, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:53,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51dd2d24 to 127.0.0.1:61286 2023-07-23 10:06:53,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:53,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-23 10:06:53,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:06:53,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 10:06:53,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 10:06:53,336 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 10:06:53,337 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690107413337 2023-07-23 10:06:53,337 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-23 10:06:53,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 10:06:53,338 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:06:53,338 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:06:53,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 10:06:53,342 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 10:06:53,343 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-23 10:06:53,344 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 10:06:53,345 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690107413345 2023-07-23 10:06:53,361 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-23 10:06:53,361 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-23 10:06:53,361 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:53,362 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-23 10:06:53,362 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-23 10:06:53,363 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,363 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,364 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,364 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:53,364 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:53,364 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:53,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:53,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:53,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:53,365 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:53,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:53,365 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:53,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,365 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,365 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:06:53,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,366 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-23 10:06:53,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-23 10:06:53,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,366 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 10:06:53,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-23 10:06:53,366 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 10:06:53,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,366 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 10:06:53,366 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-23 10:06:53,366 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-23 10:06:53,367 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 10:06:53,367 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 10:06:53,367 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:53,367 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-23 10:06:53,368 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 10:06:53,368 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 10:06:53,368 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:53,367 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:53,369 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 10:06:53,370 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 10:06:53,368 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-23 10:06:53,370 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-23 10:06:53,370 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35943,1690106767812' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-23 10:06:53,370 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-23 10:06:53,370 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-23 10:06:53,370 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44315,1690106767755' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-23 10:06:53,372 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,373 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,373 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,374 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,374 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:53,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:53,374 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,374 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,374 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:53,374 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:53,374 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:53,374 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:53,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:53,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 10:06:53,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:53,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-23 10:06:53,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ad45eb9[Count = 1] remaining members to acquire global barrier 2023-07-23 10:06:53,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:53,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:53,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:53,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:53,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 10:06:53,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:53,381 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44315,1690106767755' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-23 10:06:53,381 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ad45eb9[Count = 0] remaining members to acquire global barrier 2023-07-23 10:06:53,381 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-23 10:06:53,381 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,383 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,383 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,383 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,383 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 10:06:53,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,384 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,384 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:53,384 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:53,384 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 10:06:53,384 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. 2023-07-23 10:06:53,384 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,384 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:53,384 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d. 2023-07-23 10:06:53,384 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 10:06:53,384 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d. started... 2023-07-23 10:06:53,384 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:53,384 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:06:53,384 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. started... 2023-07-23 10:06:53,384 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-23 10:06:53,385 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35943,1690106767812' in zk 2023-07-23 10:06:53,385 INFO [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 11e7b7d4fe071b96d3274fe00a0d827d 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-23 10:06:53,385 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8d2efd932fbadd58477acd79fe8ddc32 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-23 10:06:53,387 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 10:06:53,387 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:53,387 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-23 10:06:53,417 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/8d2efd932fbadd58477acd79fe8ddc32/.tmp/cf/53623af89c5a4380b6ba4bb2b616d24d 2023-07-23 10:06:53,418 INFO [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/11e7b7d4fe071b96d3274fe00a0d827d/.tmp/cf/56c111308c54459d869c49604cfc3c61 2023-07-23 10:06:53,436 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/11e7b7d4fe071b96d3274fe00a0d827d/.tmp/cf/56c111308c54459d869c49604cfc3c61 as hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/11e7b7d4fe071b96d3274fe00a0d827d/cf/56c111308c54459d869c49604cfc3c61 2023-07-23 10:06:53,436 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/8d2efd932fbadd58477acd79fe8ddc32/.tmp/cf/53623af89c5a4380b6ba4bb2b616d24d as hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/8d2efd932fbadd58477acd79fe8ddc32/cf/53623af89c5a4380b6ba4bb2b616d24d 2023-07-23 10:06:53,438 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:53,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 10:06:53,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:06:53,441 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:06:53,444 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/8d2efd932fbadd58477acd79fe8ddc32/cf/53623af89c5a4380b6ba4bb2b616d24d, entries=3, sequenceid=6, filesize=5.0 K 2023-07-23 10:06:53,445 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 8d2efd932fbadd58477acd79fe8ddc32 in 60ms, sequenceid=6, compaction requested=false 2023-07-23 10:06:53,445 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-23 10:06:53,446 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8d2efd932fbadd58477acd79fe8ddc32: 2023-07-23 10:06:53,446 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-23 10:06:53,446 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:53,446 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/8d2efd932fbadd58477acd79fe8ddc32/cf/53623af89c5a4380b6ba4bb2b616d24d] hfiles 2023-07-23 10:06:53,446 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/8d2efd932fbadd58477acd79fe8ddc32/cf/53623af89c5a4380b6ba4bb2b616d24d for snapshot=snaptb0-testConsecutiveExports 2023-07-23 10:06:53,447 INFO [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/11e7b7d4fe071b96d3274fe00a0d827d/cf/56c111308c54459d869c49604cfc3c61, entries=47, sequenceid=6, filesize=8 K 2023-07-23 10:06:53,448 INFO [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 11e7b7d4fe071b96d3274fe00a0d827d in 63ms, sequenceid=6, compaction requested=false 2023-07-23 10:06:53,450 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 11e7b7d4fe071b96d3274fe00a0d827d: 2023-07-23 10:06:53,450 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-23 10:06:53,450 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:53,450 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/11e7b7d4fe071b96d3274fe00a0d827d/cf/56c111308c54459d869c49604cfc3c61] hfiles 2023-07-23 10:06:53,450 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/11e7b7d4fe071b96d3274fe00a0d827d/cf/56c111308c54459d869c49604cfc3c61 for snapshot=snaptb0-testConsecutiveExports 2023-07-23 10:06:53,485 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. completed. 2023-07-23 10:06:53,486 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. 2023-07-23 10:06:53,486 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:53,486 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:53,486 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,486 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-23 10:06:53,486 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43301,1690106767667' in zk 2023-07-23 10:06:53,488 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 10:06:53,488 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,488 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:53,488 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-23 10:06:53,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:53,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:53,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:53,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:53,491 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d. completed. 2023-07-23 10:06:53,492 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d. 2023-07-23 10:06:53,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 10:06:53,492 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:53,492 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:53,492 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,492 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-23 10:06:53,492 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44315,1690106767755' in zk 2023-07-23 10:06:53,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,493 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,493 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 10:06:53,494 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:53,494 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-23 10:06:53,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:53,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 10:06:53,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43301,1690106767667': 2023-07-23 10:06:53,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-23 10:06:53,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:53,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:53,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:53,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:53,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 10:06:53,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:53,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 10:06:53,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44315,1690106767755': 2023-07-23 10:06:53,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44315,1690106767755' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-23 10:06:53,504 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-23 10:06:53,504 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:06:53,504 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:06:53,504 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-23 10:06:53,504 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:06:53,507 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,508 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,508 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:53,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:53,508 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,508 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:53,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,508 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:53,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,508 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:53,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:53,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:53,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:53,508 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:53,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:53,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 10:06:53,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:53,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:53,509 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:53,510 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 10:06:53,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:53,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 10:06:53,511 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,512 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,512 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,518 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:53,519 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:53,519 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:53,519 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,519 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:53,519 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:53,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:53,519 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:53,519 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:53,521 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:53,519 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-23 10:06:53,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:53,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:53,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:53,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:53,519 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,521 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,521 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:06:53,521 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,521 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:06:53,521 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:06:53,521 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,521 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,519 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:53,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:53,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-23 10:06:53,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:53,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:53,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:53,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:53,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,573 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-23 10:06:53,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,573 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690106813337Consolidate snapshot: snaptb0-testConsecutiveExports at 1690106813521 (+184 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1690106813522 (+1 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1690106813529 (+7 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1690106813545 (+16 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690106813573 (+28 ms) 2023-07-23 10:06:53,576 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 10:06:53,578 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 238 msec 2023-07-23 10:06:53,642 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:53,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 10:06:53,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:06:53,643 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/local-export-1690106813643 2023-07-23 10:06:53,643 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/local-export-1690106813643, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/local-export-1690106813643, srcFsUri=hdfs://localhost:39321, srcDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa 2023-07-23 10:06:53,672 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39321, inputRoot=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa 2023-07-23 10:06:53,672 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@58ce8518, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/local-export-1690106813643, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/local-export-1690106813643/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,672 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39321, inputRoot=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa, snapshotDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-23 10:06:53,682 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/local-export-1690106813643/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 10:06:53,697 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:53,698 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:53,698 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:53,699 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:53,699 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:53,699 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:53,700 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:53,769 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/hadoop-4416066871251064182.jar 2023-07-23 10:06:53,770 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:53,771 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:53,771 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:53,771 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:53,772 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:53,772 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:53,772 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 10:06:53,773 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 10:06:53,773 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 10:06:53,773 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 10:06:53,774 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 10:06:53,774 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 10:06:53,774 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 10:06:53,775 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 10:06:53,775 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 10:06:53,776 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 10:06:53,776 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:53,776 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:53,777 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:06:53,777 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:53,777 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:53,778 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:06:53,778 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:06:54,553 WARN [Listener at jenkins-hbase4.apache.org/44999] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 10:06:54,555 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-23 10:06:54,558 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-23 10:06:56,749 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:06:56,749 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:06:56,753 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0002_000001 (auth:SIMPLE) 2023-07-23 10:06:57,466 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0003_000001 (auth:SIMPLE) 2023-07-23 10:06:57,624 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 10:07:01,660 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0003_000001 (auth:SIMPLE) 2023-07-23 10:07:03,974 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0003_000001 (auth:SIMPLE) 2023-07-23 10:07:07,054 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0003_000001 (auth:SIMPLE) 2023-07-23 10:07:08,778 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 10:07:08,778 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 10:07:08,782 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-23 10:07:08,782 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 10:07:08,783 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 10:07:08,783 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-372295689_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 10:07:08,785 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 10:07:08,785 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 10:07:08,785 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@9165e97 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/local-export-1690106813643/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/local-export-1690106813643/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 10:07:08,785 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/local-export-1690106813643/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 10:07:08,785 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/local-export-1690106813643/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 10:07:08,787 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/local-export-1690106813643, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/local-export-1690106813643, srcFsUri=hdfs://localhost:39321, srcDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa 2023-07-23 10:07:08,808 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39321, inputRoot=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa 2023-07-23 10:07:08,809 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3c7e86be, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/local-export-1690106813643, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/local-export-1690106813643/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 10:07:08,809 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39321, inputRoot=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa, snapshotDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-23 10:07:08,820 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/local-export-1690106813643/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 10:07:08,832 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:08,832 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:08,833 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:08,833 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:08,833 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:08,833 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:08,834 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:08,901 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/hadoop-1412255424307772812.jar 2023-07-23 10:07:08,902 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:08,902 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:08,903 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:08,903 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:08,903 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:08,903 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:08,904 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 10:07:08,904 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 10:07:08,905 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 10:07:08,905 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 10:07:08,905 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 10:07:08,906 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 10:07:08,906 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 10:07:08,906 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 10:07:08,907 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 10:07:08,907 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 10:07:08,908 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:08,908 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:08,908 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:07:08,909 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:08,909 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:08,909 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:07:08,909 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:07:09,275 WARN [Listener at jenkins-hbase4.apache.org/44999] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 10:07:09,278 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-23 10:07:09,280 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-23 10:07:13,237 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:07:13,237 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:07:13,241 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0003_000001 (auth:SIMPLE) 2023-07-23 10:07:14,077 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0004_000001 (auth:SIMPLE) 2023-07-23 10:07:18,296 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0004_000001 (auth:SIMPLE) 2023-07-23 10:07:20,552 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0004_000001 (auth:SIMPLE) 2023-07-23 10:07:23,169 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0004_000001 (auth:SIMPLE) 2023-07-23 10:07:24,540 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 10:07:24,540 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 10:07:24,543 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-23 10:07:24,543 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 10:07:24,544 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 10:07:24,544 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-372295689_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 10:07:24,548 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 10:07:24,548 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 10:07:24,548 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@9165e97 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/local-export-1690106813643/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/local-export-1690106813643/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 10:07:24,549 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/local-export-1690106813643/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 10:07:24,549 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/local-export-1690106813643/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 10:07:24,562 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-23 10:07:24,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-23 10:07:24,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-23 10:07:24,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-23 10:07:24,573 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106844572"}]},"ts":"1690106844572"} 2023-07-23 10:07:24,574 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-23 10:07:24,576 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-23 10:07:24,577 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8d2efd932fbadd58477acd79fe8ddc32, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=11e7b7d4fe071b96d3274fe00a0d827d, UNASSIGN}] 2023-07-23 10:07:24,579 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8d2efd932fbadd58477acd79fe8ddc32, UNASSIGN 2023-07-23 10:07:24,580 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=11e7b7d4fe071b96d3274fe00a0d827d, UNASSIGN 2023-07-23 10:07:24,580 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=8d2efd932fbadd58477acd79fe8ddc32, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:24,580 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=11e7b7d4fe071b96d3274fe00a0d827d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:24,581 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690106844580"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106844580"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106844580"}]},"ts":"1690106844580"} 2023-07-23 10:07:24,581 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690106844580"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106844580"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106844580"}]},"ts":"1690106844580"} 2023-07-23 10:07:24,582 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 8d2efd932fbadd58477acd79fe8ddc32, server=jenkins-hbase4.apache.org,43301,1690106767667}] 2023-07-23 10:07:24,584 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 11e7b7d4fe071b96d3274fe00a0d827d, server=jenkins-hbase4.apache.org,44315,1690106767755}] 2023-07-23 10:07:24,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-23 10:07:24,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8d2efd932fbadd58477acd79fe8ddc32 2023-07-23 10:07:24,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8d2efd932fbadd58477acd79fe8ddc32, disabling compactions & flushes 2023-07-23 10:07:24,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. 2023-07-23 10:07:24,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. 2023-07-23 10:07:24,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. after waiting 0 ms 2023-07-23 10:07:24,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. 2023-07-23 10:07:24,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 11e7b7d4fe071b96d3274fe00a0d827d 2023-07-23 10:07:24,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 11e7b7d4fe071b96d3274fe00a0d827d, disabling compactions & flushes 2023-07-23 10:07:24,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d. 2023-07-23 10:07:24,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d. 2023-07-23 10:07:24,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d. after waiting 0 ms 2023-07-23 10:07:24,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d. 2023-07-23 10:07:24,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/8d2efd932fbadd58477acd79fe8ddc32/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:07:24,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testConsecutiveExports/11e7b7d4fe071b96d3274fe00a0d827d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:07:24,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:07:24,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32. 2023-07-23 10:07:24,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8d2efd932fbadd58477acd79fe8ddc32: 2023-07-23 10:07:24,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:07:24,766 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d. 2023-07-23 10:07:24,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 11e7b7d4fe071b96d3274fe00a0d827d: 2023-07-23 10:07:24,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8d2efd932fbadd58477acd79fe8ddc32 2023-07-23 10:07:24,769 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=8d2efd932fbadd58477acd79fe8ddc32, regionState=CLOSED 2023-07-23 10:07:24,769 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 11e7b7d4fe071b96d3274fe00a0d827d 2023-07-23 10:07:24,769 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690106844769"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106844769"}]},"ts":"1690106844769"} 2023-07-23 10:07:24,770 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=11e7b7d4fe071b96d3274fe00a0d827d, regionState=CLOSED 2023-07-23 10:07:24,770 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690106844770"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106844770"}]},"ts":"1690106844770"} 2023-07-23 10:07:24,773 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-23 10:07:24,773 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 8d2efd932fbadd58477acd79fe8ddc32, server=jenkins-hbase4.apache.org,43301,1690106767667 in 189 msec 2023-07-23 10:07:24,775 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8d2efd932fbadd58477acd79fe8ddc32, UNASSIGN in 196 msec 2023-07-23 10:07:24,775 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-23 10:07:24,775 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 11e7b7d4fe071b96d3274fe00a0d827d, server=jenkins-hbase4.apache.org,44315,1690106767755 in 189 msec 2023-07-23 10:07:24,777 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-23 10:07:24,777 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=11e7b7d4fe071b96d3274fe00a0d827d, UNASSIGN in 198 msec 2023-07-23 10:07:24,778 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106844778"}]},"ts":"1690106844778"} 2023-07-23 10:07:24,779 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-23 10:07:24,781 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-23 10:07:24,785 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 219 msec 2023-07-23 10:07:24,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-23 10:07:24,873 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-23 10:07:24,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-23 10:07:24,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 10:07:24,877 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 10:07:24,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-23 10:07:24,878 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 10:07:24,882 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-23 10:07:24,885 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 10:07:24,885 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 10:07:24,885 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 10:07:24,885 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 10:07:24,885 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-23 10:07:24,886 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-23 10:07:24,886 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-23 10:07:24,886 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-23 10:07:24,887 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 10:07:24,887 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 10:07:24,887 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 10:07:24,887 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:24,887 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:24,887 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:24,887 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 10:07:24,887 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:24,887 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testConsecutiveExports/8d2efd932fbadd58477acd79fe8ddc32 2023-07-23 10:07:24,887 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testConsecutiveExports/11e7b7d4fe071b96d3274fe00a0d827d 2023-07-23 10:07:24,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-23 10:07:24,890 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testConsecutiveExports/8d2efd932fbadd58477acd79fe8ddc32/cf, FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testConsecutiveExports/8d2efd932fbadd58477acd79fe8ddc32/recovered.edits] 2023-07-23 10:07:24,890 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testConsecutiveExports/11e7b7d4fe071b96d3274fe00a0d827d/cf, FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testConsecutiveExports/11e7b7d4fe071b96d3274fe00a0d827d/recovered.edits] 2023-07-23 10:07:24,894 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testConsecutiveExports/8d2efd932fbadd58477acd79fe8ddc32/cf/53623af89c5a4380b6ba4bb2b616d24d to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testConsecutiveExports/8d2efd932fbadd58477acd79fe8ddc32/cf/53623af89c5a4380b6ba4bb2b616d24d 2023-07-23 10:07:24,894 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testConsecutiveExports/11e7b7d4fe071b96d3274fe00a0d827d/cf/56c111308c54459d869c49604cfc3c61 to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testConsecutiveExports/11e7b7d4fe071b96d3274fe00a0d827d/cf/56c111308c54459d869c49604cfc3c61 2023-07-23 10:07:24,898 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testConsecutiveExports/8d2efd932fbadd58477acd79fe8ddc32/recovered.edits/9.seqid to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testConsecutiveExports/8d2efd932fbadd58477acd79fe8ddc32/recovered.edits/9.seqid 2023-07-23 10:07:24,898 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testConsecutiveExports/11e7b7d4fe071b96d3274fe00a0d827d/recovered.edits/9.seqid to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testConsecutiveExports/11e7b7d4fe071b96d3274fe00a0d827d/recovered.edits/9.seqid 2023-07-23 10:07:24,899 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testConsecutiveExports/8d2efd932fbadd58477acd79fe8ddc32 2023-07-23 10:07:24,899 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testConsecutiveExports/11e7b7d4fe071b96d3274fe00a0d827d 2023-07-23 10:07:24,899 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-23 10:07:24,902 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 10:07:24,905 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-23 10:07:24,911 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-23 10:07:24,913 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 10:07:24,913 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-23 10:07:24,913 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106844913"}]},"ts":"9223372036854775807"} 2023-07-23 10:07:24,913 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106844913"}]},"ts":"9223372036854775807"} 2023-07-23 10:07:24,915 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 10:07:24,915 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8d2efd932fbadd58477acd79fe8ddc32, NAME => 'testtb-testConsecutiveExports,,1690106812322.8d2efd932fbadd58477acd79fe8ddc32.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 11e7b7d4fe071b96d3274fe00a0d827d, NAME => 'testtb-testConsecutiveExports,1,1690106812322.11e7b7d4fe071b96d3274fe00a0d827d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 10:07:24,915 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-23 10:07:24,915 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690106844915"}]},"ts":"9223372036854775807"} 2023-07-23 10:07:24,917 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-23 10:07:24,920 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 10:07:24,921 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 46 msec 2023-07-23 10:07:24,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-23 10:07:24,989 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-23 10:07:24,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-23 10:07:25,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-23 10:07:25,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-23 10:07:25,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-23 10:07:25,028 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=748 (was 770), OpenFileDescriptor=902 (was 929), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=337 (was 260) - SystemLoadAverage LEAK? -, ProcessCount=176 (was 179), AvailableMemoryMB=6962 (was 6450) - AvailableMemoryMB LEAK? - 2023-07-23 10:07:25,028 WARN [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-23 10:07:25,047 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=748, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=337, ProcessCount=176, AvailableMemoryMB=6961 2023-07-23 10:07:25,047 WARN [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-23 10:07:25,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 10:07:25,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,052 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 10:07:25,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-23 10:07:25,053 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 10:07:25,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 10:07:25,055 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a17b0e1bb2b5b3c2629ae18dbf70336 2023-07-23 10:07:25,056 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c54b83919df3df5d0e4b4d6dde1ef4e7 2023-07-23 10:07:25,056 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a17b0e1bb2b5b3c2629ae18dbf70336 empty. 2023-07-23 10:07:25,056 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c54b83919df3df5d0e4b4d6dde1ef4e7 empty. 2023-07-23 10:07:25,056 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a17b0e1bb2b5b3c2629ae18dbf70336 2023-07-23 10:07:25,056 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c54b83919df3df5d0e4b4d6dde1ef4e7 2023-07-23 10:07:25,057 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-23 10:07:25,069 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-23 10:07:25,071 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => c54b83919df3df5d0e4b4d6dde1ef4e7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp 2023-07-23 10:07:25,071 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1a17b0e1bb2b5b3c2629ae18dbf70336, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp 2023-07-23 10:07:25,102 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:25,103 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing c54b83919df3df5d0e4b4d6dde1ef4e7, disabling compactions & flushes 2023-07-23 10:07:25,103 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7. 2023-07-23 10:07:25,103 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7. 2023-07-23 10:07:25,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7. after waiting 0 ms 2023-07-23 10:07:25,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7. 2023-07-23 10:07:25,104 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7. 2023-07-23 10:07:25,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for c54b83919df3df5d0e4b4d6dde1ef4e7: 2023-07-23 10:07:25,107 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:25,107 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 1a17b0e1bb2b5b3c2629ae18dbf70336, disabling compactions & flushes 2023-07-23 10:07:25,107 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. 2023-07-23 10:07:25,107 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. 2023-07-23 10:07:25,107 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. after waiting 0 ms 2023-07-23 10:07:25,107 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. 2023-07-23 10:07:25,107 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. 2023-07-23 10:07:25,107 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 1a17b0e1bb2b5b3c2629ae18dbf70336: 2023-07-23 10:07:25,110 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 10:07:25,111 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690106845111"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106845111"}]},"ts":"1690106845111"} 2023-07-23 10:07:25,111 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690106845111"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106845111"}]},"ts":"1690106845111"} 2023-07-23 10:07:25,118 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 10:07:25,119 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 10:07:25,119 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106845119"}]},"ts":"1690106845119"} 2023-07-23 10:07:25,121 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-23 10:07:25,125 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 10:07:25,126 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 10:07:25,126 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 10:07:25,126 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 10:07:25,126 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 10:07:25,127 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1a17b0e1bb2b5b3c2629ae18dbf70336, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c54b83919df3df5d0e4b4d6dde1ef4e7, ASSIGN}] 2023-07-23 10:07:25,129 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c54b83919df3df5d0e4b4d6dde1ef4e7, ASSIGN 2023-07-23 10:07:25,130 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1a17b0e1bb2b5b3c2629ae18dbf70336, ASSIGN 2023-07-23 10:07:25,130 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c54b83919df3df5d0e4b4d6dde1ef4e7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35943,1690106767812; forceNewPlan=false, retain=false 2023-07-23 10:07:25,130 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1a17b0e1bb2b5b3c2629ae18dbf70336, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43301,1690106767667; forceNewPlan=false, retain=false 2023-07-23 10:07:25,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 10:07:25,281 INFO [jenkins-hbase4:39043] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 10:07:25,284 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=1a17b0e1bb2b5b3c2629ae18dbf70336, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:25,284 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=c54b83919df3df5d0e4b4d6dde1ef4e7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:25,284 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690106845284"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106845284"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106845284"}]},"ts":"1690106845284"} 2023-07-23 10:07:25,284 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690106845284"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106845284"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106845284"}]},"ts":"1690106845284"} 2023-07-23 10:07:25,287 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 1a17b0e1bb2b5b3c2629ae18dbf70336, server=jenkins-hbase4.apache.org,43301,1690106767667}] 2023-07-23 10:07:25,288 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure c54b83919df3df5d0e4b4d6dde1ef4e7, server=jenkins-hbase4.apache.org,35943,1690106767812}] 2023-07-23 10:07:25,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 10:07:25,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. 2023-07-23 10:07:25,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1a17b0e1bb2b5b3c2629ae18dbf70336, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 10:07:25,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7. 2023-07-23 10:07:25,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. service=AccessControlService 2023-07-23 10:07:25,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c54b83919df3df5d0e4b4d6dde1ef4e7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 10:07:25,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:07:25,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7. service=AccessControlService 2023-07-23 10:07:25,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 1a17b0e1bb2b5b3c2629ae18dbf70336 2023-07-23 10:07:25,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:25,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:07:25,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1a17b0e1bb2b5b3c2629ae18dbf70336 2023-07-23 10:07:25,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1a17b0e1bb2b5b3c2629ae18dbf70336 2023-07-23 10:07:25,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion c54b83919df3df5d0e4b4d6dde1ef4e7 2023-07-23 10:07:25,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:25,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c54b83919df3df5d0e4b4d6dde1ef4e7 2023-07-23 10:07:25,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c54b83919df3df5d0e4b4d6dde1ef4e7 2023-07-23 10:07:25,449 INFO [StoreOpener-1a17b0e1bb2b5b3c2629ae18dbf70336-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1a17b0e1bb2b5b3c2629ae18dbf70336 2023-07-23 10:07:25,449 INFO [StoreOpener-c54b83919df3df5d0e4b4d6dde1ef4e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c54b83919df3df5d0e4b4d6dde1ef4e7 2023-07-23 10:07:25,451 DEBUG [StoreOpener-1a17b0e1bb2b5b3c2629ae18dbf70336-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a17b0e1bb2b5b3c2629ae18dbf70336/cf 2023-07-23 10:07:25,451 DEBUG [StoreOpener-c54b83919df3df5d0e4b4d6dde1ef4e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/c54b83919df3df5d0e4b4d6dde1ef4e7/cf 2023-07-23 10:07:25,451 DEBUG [StoreOpener-1a17b0e1bb2b5b3c2629ae18dbf70336-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a17b0e1bb2b5b3c2629ae18dbf70336/cf 2023-07-23 10:07:25,451 DEBUG [StoreOpener-c54b83919df3df5d0e4b4d6dde1ef4e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/c54b83919df3df5d0e4b4d6dde1ef4e7/cf 2023-07-23 10:07:25,453 INFO [StoreOpener-1a17b0e1bb2b5b3c2629ae18dbf70336-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a17b0e1bb2b5b3c2629ae18dbf70336 columnFamilyName cf 2023-07-23 10:07:25,453 INFO [StoreOpener-c54b83919df3df5d0e4b4d6dde1ef4e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c54b83919df3df5d0e4b4d6dde1ef4e7 columnFamilyName cf 2023-07-23 10:07:25,453 INFO [StoreOpener-1a17b0e1bb2b5b3c2629ae18dbf70336-1] regionserver.HStore(310): Store=1a17b0e1bb2b5b3c2629ae18dbf70336/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:07:25,453 INFO [StoreOpener-c54b83919df3df5d0e4b4d6dde1ef4e7-1] regionserver.HStore(310): Store=c54b83919df3df5d0e4b4d6dde1ef4e7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:07:25,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a17b0e1bb2b5b3c2629ae18dbf70336 2023-07-23 10:07:25,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/c54b83919df3df5d0e4b4d6dde1ef4e7 2023-07-23 10:07:25,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a17b0e1bb2b5b3c2629ae18dbf70336 2023-07-23 10:07:25,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/c54b83919df3df5d0e4b4d6dde1ef4e7 2023-07-23 10:07:25,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1a17b0e1bb2b5b3c2629ae18dbf70336 2023-07-23 10:07:25,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c54b83919df3df5d0e4b4d6dde1ef4e7 2023-07-23 10:07:25,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a17b0e1bb2b5b3c2629ae18dbf70336/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:07:25,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/c54b83919df3df5d0e4b4d6dde1ef4e7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:07:25,470 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1a17b0e1bb2b5b3c2629ae18dbf70336; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73639541, jitterRate=0.09731467068195343}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:07:25,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1a17b0e1bb2b5b3c2629ae18dbf70336: 2023-07-23 10:07:25,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c54b83919df3df5d0e4b4d6dde1ef4e7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72883593, jitterRate=0.08605016767978668}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:07:25,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c54b83919df3df5d0e4b4d6dde1ef4e7: 2023-07-23 10:07:25,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7., pid=61, masterSystemTime=1690106845440 2023-07-23 10:07:25,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336., pid=60, masterSystemTime=1690106845440 2023-07-23 10:07:25,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7. 2023-07-23 10:07:25,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7. 2023-07-23 10:07:25,475 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=c54b83919df3df5d0e4b4d6dde1ef4e7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:25,475 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690106845474"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106845474"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106845474"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106845474"}]},"ts":"1690106845474"} 2023-07-23 10:07:25,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. 2023-07-23 10:07:25,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. 2023-07-23 10:07:25,476 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=1a17b0e1bb2b5b3c2629ae18dbf70336, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:25,477 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690106845476"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106845476"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106845476"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106845476"}]},"ts":"1690106845476"} 2023-07-23 10:07:25,479 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-23 10:07:25,479 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure c54b83919df3df5d0e4b4d6dde1ef4e7, server=jenkins-hbase4.apache.org,35943,1690106767812 in 189 msec 2023-07-23 10:07:25,483 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c54b83919df3df5d0e4b4d6dde1ef4e7, ASSIGN in 352 msec 2023-07-23 10:07:25,483 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-23 10:07:25,483 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 1a17b0e1bb2b5b3c2629ae18dbf70336, server=jenkins-hbase4.apache.org,43301,1690106767667 in 191 msec 2023-07-23 10:07:25,485 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-23 10:07:25,485 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1a17b0e1bb2b5b3c2629ae18dbf70336, ASSIGN in 356 msec 2023-07-23 10:07:25,487 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 10:07:25,487 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106845487"}]},"ts":"1690106845487"} 2023-07-23 10:07:25,489 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-23 10:07:25,491 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 10:07:25,491 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-23 10:07:25,493 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-23 10:07:25,495 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:25,495 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:25,495 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:25,495 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:25,496 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:25,496 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:25,496 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:25,497 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:25,498 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 447 msec 2023-07-23 10:07:25,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 10:07:25,658 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-23 10:07:25,659 DEBUG [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-23 10:07:25,659 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:07:25,662 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-23 10:07:25,662 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:07:25,662 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-23 10:07:25,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 10:07:25,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106845665 (current time:1690106845665). 2023-07-23 10:07:25,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:07:25,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x2f743d47 to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:07:25,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@362bc0e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:07:25,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:25,678 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36382, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:25,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f743d47 to 127.0.0.1:61286 2023-07-23 10:07:25,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:07:25,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x493d00c2 to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:07:25,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@472d92a7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:07:25,689 DEBUG [hconnection-0x5139c480-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:25,690 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:25,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:25,697 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:25,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x493d00c2 to 127.0.0.1:61286 2023-07-23 10:07:25,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:07:25,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-23 10:07:25,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:07:25,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 10:07:25,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 10:07:25,703 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 10:07:25,705 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690107445705 2023-07-23 10:07:25,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 10:07:25,706 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,707 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:07:25,707 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:07:25,709 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 10:07:25,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 10:07:25,713 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 9 msec 2023-07-23 10:07:25,714 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 10:07:25,714 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690107445714 2023-07-23 10:07:25,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,743 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-23 10:07:25,743 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:25,744 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-23 10:07:25,744 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-23 10:07:25,745 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,745 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,747 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:25,747 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:25,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:25,747 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:25,747 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:25,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:25,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:25,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:25,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:25,748 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:25,748 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:25,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:25,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,749 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:25,749 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:07:25,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-23 10:07:25,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,750 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 10:07:25,750 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,750 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 10:07:25,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-23 10:07:25,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,750 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:25,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-23 10:07:25,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,750 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 10:07:25,753 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 10:07:25,753 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,753 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 10:07:25,752 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 10:07:25,753 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 10:07:25,753 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35943,1690106767812' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 10:07:25,753 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:25,758 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 10:07:25,758 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 10:07:25,759 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44315,1690106767755' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 10:07:25,760 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,760 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:25,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:25,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:25,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:25,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:25,762 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,762 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:25,761 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:25,762 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,762 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 10:07:25,762 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,762 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:25,762 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:25,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,764 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 10:07:25,764 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 10:07:25,764 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 10:07:25,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:25,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:25,766 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,766 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,766 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:25,768 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:25,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:25,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35943,1690106767812' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 10:07:25,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f574160[Count = 1] remaining members to acquire global barrier 2023-07-23 10:07:25,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:25,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:25,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:25,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:25,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:25,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:25,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:25,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:25,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:25,773 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 10:07:25,773 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f574160[Count = 0] remaining members to acquire global barrier 2023-07-23 10:07:25,773 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-23 10:07:25,773 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,778 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,778 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,778 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,778 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 10:07:25,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,778 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:07:25,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,779 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:07:25,779 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 10:07:25,779 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. 2023-07-23 10:07:25,779 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 10:07:25,779 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 10:07:25,779 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44315,1690106767755' in zk 2023-07-23 10:07:25,779 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. started... 2023-07-23 10:07:25,779 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:07:25,779 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:07:25,779 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:25,781 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7. 2023-07-23 10:07:25,781 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7. started... 2023-07-23 10:07:25,781 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1a17b0e1bb2b5b3c2629ae18dbf70336: 2023-07-23 10:07:25,783 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:25,783 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:07:25,785 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,785 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:07:25,785 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c54b83919df3df5d0e4b4d6dde1ef4e7: 2023-07-23 10:07:25,785 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:07:25,785 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,785 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:07:25,785 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:07:25,792 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 10:07:25,792 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:25,792 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 10:07:25,807 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:25,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 10:07:25,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:07:25,809 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:07:25,905 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. completed. 2023-07-23 10:07:25,905 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7. completed. 2023-07-23 10:07:25,906 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. 2023-07-23 10:07:25,906 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7. 2023-07-23 10:07:25,906 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:07:25,906 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:07:25,906 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:07:25,906 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:25,906 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:07:25,906 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 10:07:25,906 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:25,906 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35943,1690106767812' in zk 2023-07-23 10:07:25,906 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 10:07:25,906 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43301,1690106767667' in zk 2023-07-23 10:07:25,911 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:25,911 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:25,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:25,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:25,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:25,911 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 10:07:25,911 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:25,911 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 10:07:25,912 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 10:07:25,912 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:25,912 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 10:07:25,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:25,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:25,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:25,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:25,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:25,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:25,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:25,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:25,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:25,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43301,1690106767667': 2023-07-23 10:07:25,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-23 10:07:25,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:25,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:25,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:25,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:25,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:25,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:25,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:25,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:25,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:25,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:25,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:25,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:25,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35943,1690106767812': 2023-07-23 10:07:25,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35943,1690106767812' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-23 10:07:25,923 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-23 10:07:25,923 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:07:25,923 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:07:25,924 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,924 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:07:25,927 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,927 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,928 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:25,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,928 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:25,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,927 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,928 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:25,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:25,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:25,929 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:25,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:25,928 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:25,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:25,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:25,929 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:25,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:25,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:25,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:25,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,930 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:25,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:25,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:25,932 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:25,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:25,932 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:25,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:25,933 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:25,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:25,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:25,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:25,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:25,936 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:25,936 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:25,937 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:25,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:25,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:25,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:25,937 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-23 10:07:25,937 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,937 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,937 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:25,937 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:25,937 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:25,937 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:25,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:25,937 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:25,940 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:25,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:25,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:25,937 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:25,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:25,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:25,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:25,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:25,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:25,940 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:25,940 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,940 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:25,941 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,941 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:25,941 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:25,941 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,941 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,014 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:26,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 10:07:26,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:07:26,016 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 10:07:26,037 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-23 10:07:26,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,038 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690106845706Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690106845937 (+231 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690106845939 (+2 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690106845952 (+13 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690106845969 (+17 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690106846037 (+68 ms) 2023-07-23 10:07:26,041 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 10:07:26,047 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 334 msec 2023-07-23 10:07:26,316 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:26,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 10:07:26,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:07:26,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35943] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:07:26,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43301] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:07:26,340 DEBUG [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,340 DEBUG [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. 2023-07-23 10:07:26,340 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:07:26,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 10:07:26,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106846353 (current time:1690106846353). 2023-07-23 10:07:26,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:07:26,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x742a85ff to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:07:26,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e80b724, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:07:26,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:26,376 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:26,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x742a85ff to 127.0.0.1:61286 2023-07-23 10:07:26,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:07:26,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x2d70adab to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:07:26,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d55c087, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:07:26,394 DEBUG [hconnection-0x16f77f9e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:26,398 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:26,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:26,405 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:26,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d70adab to 127.0.0.1:61286 2023-07-23 10:07:26,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:07:26,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-23 10:07:26,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:07:26,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 10:07:26,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 10:07:26,412 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 10:07:26,413 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690107446413 2023-07-23 10:07:26,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 10:07:26,413 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,414 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:07:26,414 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:07:26,416 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 10:07:26,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 10:07:26,419 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-23 10:07:26,420 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 10:07:26,423 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690107446423 2023-07-23 10:07:26,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,447 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-23 10:07:26,447 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:26,449 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-23 10:07:26,449 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-23 10:07:26,450 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,450 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,451 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:26,452 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:26,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:26,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:26,452 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:26,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:26,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:26,452 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:26,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:26,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:26,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,452 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:26,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,452 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:26,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,453 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:26,453 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:07:26,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-23 10:07:26,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-23 10:07:26,454 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 10:07:26,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-23 10:07:26,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,454 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 10:07:26,454 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 10:07:26,454 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,454 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 10:07:26,454 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:26,460 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 10:07:26,460 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 10:07:26,460 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35943,1690106767812' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 10:07:26,462 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,462 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,463 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 10:07:26,463 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:26,464 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 10:07:26,464 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 10:07:26,464 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 10:07:26,466 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 10:07:26,466 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:26,467 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,468 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 10:07:26,468 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 10:07:26,468 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44315,1690106767755' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 10:07:26,466 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:26,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:26,470 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,470 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:26,470 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:26,471 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:26,471 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,471 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,471 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:26,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:26,471 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,471 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:26,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:26,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:26,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:26,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35943,1690106767812' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 10:07:26,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4026df98[Count = 1] remaining members to acquire global barrier 2023-07-23 10:07:26,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:26,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:26,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:26,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:26,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:26,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:26,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 10:07:26,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4026df98[Count = 0] remaining members to acquire global barrier 2023-07-23 10:07:26,475 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-23 10:07:26,475 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,476 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,476 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,476 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,477 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 10:07:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,477 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 10:07:26,477 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 10:07:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,477 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44315,1690106767755' in zk 2023-07-23 10:07:26,477 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:07:26,477 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. 2023-07-23 10:07:26,477 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:07:26,477 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. started... 2023-07-23 10:07:26,477 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 10:07:26,477 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1a17b0e1bb2b5b3c2629ae18dbf70336 1/1 column families, dataSize=534 B heapSize=1.38 KB 2023-07-23 10:07:26,479 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:26,481 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 10:07:26,481 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:26,481 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:07:26,481 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:26,481 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 10:07:26,482 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:07:26,484 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:07:26,484 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7. 2023-07-23 10:07:26,484 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7. started... 2023-07-23 10:07:26,484 INFO [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c54b83919df3df5d0e4b4d6dde1ef4e7 1/1 column families, dataSize=2.74 KB heapSize=6.16 KB 2023-07-23 10:07:26,515 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:26,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 10:07:26,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:07:26,516 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:07:26,530 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=534 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a17b0e1bb2b5b3c2629ae18dbf70336/.tmp/cf/c4d142ff7aa246fe8a2163c06532fbef 2023-07-23 10:07:26,537 INFO [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.74 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/c54b83919df3df5d0e4b4d6dde1ef4e7/.tmp/cf/07ea38ddfcf34104944a7d9326844ca3 2023-07-23 10:07:26,538 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a17b0e1bb2b5b3c2629ae18dbf70336/.tmp/cf/c4d142ff7aa246fe8a2163c06532fbef as hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a17b0e1bb2b5b3c2629ae18dbf70336/cf/c4d142ff7aa246fe8a2163c06532fbef 2023-07-23 10:07:26,571 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/c54b83919df3df5d0e4b4d6dde1ef4e7/.tmp/cf/07ea38ddfcf34104944a7d9326844ca3 as hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/c54b83919df3df5d0e4b4d6dde1ef4e7/cf/07ea38ddfcf34104944a7d9326844ca3 2023-07-23 10:07:26,573 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a17b0e1bb2b5b3c2629ae18dbf70336/cf/c4d142ff7aa246fe8a2163c06532fbef, entries=8, sequenceid=6, filesize=5.4 K 2023-07-23 10:07:26,575 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~534 B/534, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 1a17b0e1bb2b5b3c2629ae18dbf70336 in 98ms, sequenceid=6, compaction requested=false 2023-07-23 10:07:26,575 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-23 10:07:26,576 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1a17b0e1bb2b5b3c2629ae18dbf70336: 2023-07-23 10:07:26,576 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,576 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:07:26,576 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a17b0e1bb2b5b3c2629ae18dbf70336/cf/c4d142ff7aa246fe8a2163c06532fbef] hfiles 2023-07-23 10:07:26,576 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a17b0e1bb2b5b3c2629ae18dbf70336/cf/c4d142ff7aa246fe8a2163c06532fbef for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,581 INFO [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/c54b83919df3df5d0e4b4d6dde1ef4e7/cf/07ea38ddfcf34104944a7d9326844ca3, entries=42, sequenceid=6, filesize=7.7 K 2023-07-23 10:07:26,583 INFO [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.74 KB/2802, heapSize ~6.14 KB/6288, currentSize=0 B/0 for c54b83919df3df5d0e4b4d6dde1ef4e7 in 99ms, sequenceid=6, compaction requested=false 2023-07-23 10:07:26,588 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c54b83919df3df5d0e4b4d6dde1ef4e7: 2023-07-23 10:07:26,589 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,589 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:07:26,589 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/c54b83919df3df5d0e4b4d6dde1ef4e7/cf/07ea38ddfcf34104944a7d9326844ca3] hfiles 2023-07-23 10:07:26,589 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/c54b83919df3df5d0e4b4d6dde1ef4e7/cf/07ea38ddfcf34104944a7d9326844ca3 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,631 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. completed. 2023-07-23 10:07:26,631 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. 2023-07-23 10:07:26,631 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:07:26,631 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:07:26,631 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:26,631 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 10:07:26,631 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43301,1690106767667' in zk 2023-07-23 10:07:26,633 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 10:07:26,633 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:26,634 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:26,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:26,634 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 10:07:26,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:26,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:26,635 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7. completed. 2023-07-23 10:07:26,635 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7. 2023-07-23 10:07:26,635 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:07:26,635 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:07:26,635 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:26,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:26,635 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 10:07:26,636 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35943,1690106767812' in zk 2023-07-23 10:07:26,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:26,637 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:26,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,637 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 10:07:26,638 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:26,638 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 10:07:26,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:26,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:26,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:26,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:26,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43301,1690106767667': 2023-07-23 10:07:26,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-23 10:07:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:26,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:26,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:26,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:26,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:26,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:26,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:26,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:26,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:26,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:26,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35943,1690106767812': 2023-07-23 10:07:26,646 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35943,1690106767812' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-23 10:07:26,646 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-23 10:07:26,646 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:07:26,646 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:07:26,646 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,647 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:07:26,654 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,654 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,654 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,654 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:26,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:26,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:26,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,654 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:26,654 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:26,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,655 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:26,655 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:26,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:26,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:26,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:26,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:26,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:26,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:26,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,656 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:26,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:26,657 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:26,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:26,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:26,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:26,659 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:26,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:26,659 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:26,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,660 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:26,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:26,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:26,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:26,663 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:26,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:26,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:26,663 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:26,664 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:26,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:26,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:26,664 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:26,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:26,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:26,664 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:26,664 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:26,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:26,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:26,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:26,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:26,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:26,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:26,667 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:26,667 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,667 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:26,667 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:26,667 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:26,667 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,667 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,669 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:26,669 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,669 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:26,669 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:26,669 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,669 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,697 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,716 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:26,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 10:07:26,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:07:26,718 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 10:07:26,725 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-23 10:07:26,725 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,725 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:26,725 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690106846413Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690106846669 (+256 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1690106846669Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1690106846673 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690106846690 (+17 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690106846725 (+35 ms) 2023-07-23 10:07:26,728 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 10:07:26,730 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 315 msec 2023-07-23 10:07:27,018 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:27,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 10:07:27,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:07:27,056 DEBUG [Listener at jenkins-hbase4.apache.org/44999] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 10:07:27,064 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58126, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 10:07:27,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35943] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-23 10:07:27,067 DEBUG [Listener at jenkins-hbase4.apache.org/44999] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 10:07:27,073 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46356, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 10:07:27,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43301] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-23 10:07:27,074 DEBUG [Listener at jenkins-hbase4.apache.org/44999] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 10:07:27,075 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 10:07:27,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44315] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-23 10:07:27,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 10:07:27,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,082 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 10:07:27,083 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 10:07:27,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-23 10:07:27,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 10:07:27,090 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e294bf40bb6ad660ac3db070121bc27d 2023-07-23 10:07:27,091 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f52f48aa25d4373e33467aee8475710 2023-07-23 10:07:27,092 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e294bf40bb6ad660ac3db070121bc27d empty. 2023-07-23 10:07:27,093 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f52f48aa25d4373e33467aee8475710 empty. 2023-07-23 10:07:27,093 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e294bf40bb6ad660ac3db070121bc27d 2023-07-23 10:07:27,093 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f52f48aa25d4373e33467aee8475710 2023-07-23 10:07:27,093 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-23 10:07:27,127 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-23 10:07:27,129 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => e294bf40bb6ad660ac3db070121bc27d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp 2023-07-23 10:07:27,129 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4f52f48aa25d4373e33467aee8475710, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp 2023-07-23 10:07:27,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 10:07:27,207 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:27,207 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing e294bf40bb6ad660ac3db070121bc27d, disabling compactions & flushes 2023-07-23 10:07:27,207 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d. 2023-07-23 10:07:27,207 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d. 2023-07-23 10:07:27,207 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d. after waiting 0 ms 2023-07-23 10:07:27,207 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d. 2023-07-23 10:07:27,208 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d. 2023-07-23 10:07:27,208 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for e294bf40bb6ad660ac3db070121bc27d: 2023-07-23 10:07:27,218 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:27,218 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 4f52f48aa25d4373e33467aee8475710, disabling compactions & flushes 2023-07-23 10:07:27,218 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710. 2023-07-23 10:07:27,218 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710. 2023-07-23 10:07:27,218 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710. after waiting 0 ms 2023-07-23 10:07:27,218 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710. 2023-07-23 10:07:27,218 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710. 2023-07-23 10:07:27,218 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 4f52f48aa25d4373e33467aee8475710: 2023-07-23 10:07:27,221 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 10:07:27,222 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690106847222"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106847222"}]},"ts":"1690106847222"} 2023-07-23 10:07:27,222 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690106847222"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106847222"}]},"ts":"1690106847222"} 2023-07-23 10:07:27,225 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 10:07:27,226 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 10:07:27,227 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106847227"}]},"ts":"1690106847227"} 2023-07-23 10:07:27,230 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-23 10:07:27,238 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 10:07:27,239 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 10:07:27,240 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 10:07:27,240 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 10:07:27,240 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 10:07:27,240 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e294bf40bb6ad660ac3db070121bc27d, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4f52f48aa25d4373e33467aee8475710, ASSIGN}] 2023-07-23 10:07:27,244 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4f52f48aa25d4373e33467aee8475710, ASSIGN 2023-07-23 10:07:27,244 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e294bf40bb6ad660ac3db070121bc27d, ASSIGN 2023-07-23 10:07:27,245 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e294bf40bb6ad660ac3db070121bc27d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43301,1690106767667; forceNewPlan=false, retain=false 2023-07-23 10:07:27,246 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4f52f48aa25d4373e33467aee8475710, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44315,1690106767755; forceNewPlan=false, retain=false 2023-07-23 10:07:27,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 10:07:27,395 INFO [jenkins-hbase4:39043] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 10:07:27,399 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=e294bf40bb6ad660ac3db070121bc27d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:27,399 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=4f52f48aa25d4373e33467aee8475710, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:27,399 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690106847399"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106847399"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106847399"}]},"ts":"1690106847399"} 2023-07-23 10:07:27,399 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690106847399"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106847399"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106847399"}]},"ts":"1690106847399"} 2023-07-23 10:07:27,405 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure e294bf40bb6ad660ac3db070121bc27d, server=jenkins-hbase4.apache.org,43301,1690106767667}] 2023-07-23 10:07:27,406 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 4f52f48aa25d4373e33467aee8475710, server=jenkins-hbase4.apache.org,44315,1690106767755}] 2023-07-23 10:07:27,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d. 2023-07-23 10:07:27,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e294bf40bb6ad660ac3db070121bc27d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d.', STARTKEY => '', ENDKEY => '2'} 2023-07-23 10:07:27,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d. service=AccessControlService 2023-07-23 10:07:27,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:07:27,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 e294bf40bb6ad660ac3db070121bc27d 2023-07-23 10:07:27,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:27,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e294bf40bb6ad660ac3db070121bc27d 2023-07-23 10:07:27,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e294bf40bb6ad660ac3db070121bc27d 2023-07-23 10:07:27,575 INFO [StoreOpener-e294bf40bb6ad660ac3db070121bc27d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e294bf40bb6ad660ac3db070121bc27d 2023-07-23 10:07:27,575 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710. 2023-07-23 10:07:27,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4f52f48aa25d4373e33467aee8475710, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710.', STARTKEY => '2', ENDKEY => ''} 2023-07-23 10:07:27,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710. service=AccessControlService 2023-07-23 10:07:27,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:07:27,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 4f52f48aa25d4373e33467aee8475710 2023-07-23 10:07:27,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:27,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4f52f48aa25d4373e33467aee8475710 2023-07-23 10:07:27,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4f52f48aa25d4373e33467aee8475710 2023-07-23 10:07:27,577 DEBUG [StoreOpener-e294bf40bb6ad660ac3db070121bc27d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e294bf40bb6ad660ac3db070121bc27d/cf 2023-07-23 10:07:27,577 DEBUG [StoreOpener-e294bf40bb6ad660ac3db070121bc27d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e294bf40bb6ad660ac3db070121bc27d/cf 2023-07-23 10:07:27,577 INFO [StoreOpener-e294bf40bb6ad660ac3db070121bc27d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e294bf40bb6ad660ac3db070121bc27d columnFamilyName cf 2023-07-23 10:07:27,578 INFO [StoreOpener-e294bf40bb6ad660ac3db070121bc27d-1] regionserver.HStore(310): Store=e294bf40bb6ad660ac3db070121bc27d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:07:27,581 INFO [StoreOpener-4f52f48aa25d4373e33467aee8475710-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4f52f48aa25d4373e33467aee8475710 2023-07-23 10:07:27,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e294bf40bb6ad660ac3db070121bc27d 2023-07-23 10:07:27,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e294bf40bb6ad660ac3db070121bc27d 2023-07-23 10:07:27,583 DEBUG [StoreOpener-4f52f48aa25d4373e33467aee8475710-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f52f48aa25d4373e33467aee8475710/cf 2023-07-23 10:07:27,583 DEBUG [StoreOpener-4f52f48aa25d4373e33467aee8475710-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f52f48aa25d4373e33467aee8475710/cf 2023-07-23 10:07:27,584 INFO [StoreOpener-4f52f48aa25d4373e33467aee8475710-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4f52f48aa25d4373e33467aee8475710 columnFamilyName cf 2023-07-23 10:07:27,586 INFO [StoreOpener-4f52f48aa25d4373e33467aee8475710-1] regionserver.HStore(310): Store=4f52f48aa25d4373e33467aee8475710/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:07:27,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f52f48aa25d4373e33467aee8475710 2023-07-23 10:07:27,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f52f48aa25d4373e33467aee8475710 2023-07-23 10:07:27,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e294bf40bb6ad660ac3db070121bc27d 2023-07-23 10:07:27,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4f52f48aa25d4373e33467aee8475710 2023-07-23 10:07:27,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e294bf40bb6ad660ac3db070121bc27d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:07:27,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f52f48aa25d4373e33467aee8475710/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:07:27,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4f52f48aa25d4373e33467aee8475710; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70207445, jitterRate=0.046172454953193665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:07:27,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4f52f48aa25d4373e33467aee8475710: 2023-07-23 10:07:27,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e294bf40bb6ad660ac3db070121bc27d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61427871, jitterRate=-0.08465339243412018}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:07:27,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e294bf40bb6ad660ac3db070121bc27d: 2023-07-23 10:07:27,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710., pid=70, masterSystemTime=1690106847559 2023-07-23 10:07:27,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d., pid=69, masterSystemTime=1690106847559 2023-07-23 10:07:27,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710. 2023-07-23 10:07:27,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710. 2023-07-23 10:07:27,604 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=4f52f48aa25d4373e33467aee8475710, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:27,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d. 2023-07-23 10:07:27,604 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690106847604"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106847604"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106847604"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106847604"}]},"ts":"1690106847604"} 2023-07-23 10:07:27,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d. 2023-07-23 10:07:27,605 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=e294bf40bb6ad660ac3db070121bc27d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:27,606 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690106847605"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106847605"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106847605"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106847605"}]},"ts":"1690106847605"} 2023-07-23 10:07:27,610 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-23 10:07:27,610 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 4f52f48aa25d4373e33467aee8475710, server=jenkins-hbase4.apache.org,44315,1690106767755 in 200 msec 2023-07-23 10:07:27,613 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-23 10:07:27,613 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure e294bf40bb6ad660ac3db070121bc27d, server=jenkins-hbase4.apache.org,43301,1690106767667 in 204 msec 2023-07-23 10:07:27,613 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4f52f48aa25d4373e33467aee8475710, ASSIGN in 370 msec 2023-07-23 10:07:27,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-23 10:07:27,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e294bf40bb6ad660ac3db070121bc27d, ASSIGN in 373 msec 2023-07-23 10:07:27,615 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 10:07:27,615 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106847615"}]},"ts":"1690106847615"} 2023-07-23 10:07:27,617 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-23 10:07:27,620 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 10:07:27,620 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-23 10:07:27,623 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-23 10:07:27,625 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:27,625 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:27,625 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:27,625 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:27,628 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:27,628 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:27,628 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:27,628 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:27,628 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:27,628 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:27,629 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:27,629 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:27,630 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 549 msec 2023-07-23 10:07:27,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 10:07:27,694 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-23 10:07:27,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions e294bf40bb6ad660ac3db070121bc27d, 4f52f48aa25d4373e33467aee8475710 2023-07-23 10:07:27,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e294bf40bb6ad660ac3db070121bc27d, 4f52f48aa25d4373e33467aee8475710], force=true 2023-07-23 10:07:27,732 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e294bf40bb6ad660ac3db070121bc27d, 4f52f48aa25d4373e33467aee8475710], force=true 2023-07-23 10:07:27,732 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e294bf40bb6ad660ac3db070121bc27d, 4f52f48aa25d4373e33467aee8475710], force=true 2023-07-23 10:07:27,732 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e294bf40bb6ad660ac3db070121bc27d, 4f52f48aa25d4373e33467aee8475710], force=true 2023-07-23 10:07:27,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 10:07:27,761 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e294bf40bb6ad660ac3db070121bc27d, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4f52f48aa25d4373e33467aee8475710, UNASSIGN}] 2023-07-23 10:07:27,764 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e294bf40bb6ad660ac3db070121bc27d, UNASSIGN 2023-07-23 10:07:27,764 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4f52f48aa25d4373e33467aee8475710, UNASSIGN 2023-07-23 10:07:27,765 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=e294bf40bb6ad660ac3db070121bc27d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:27,765 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=4f52f48aa25d4373e33467aee8475710, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:27,765 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690106847765"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106847765"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106847765"}]},"ts":"1690106847765"} 2023-07-23 10:07:27,765 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690106847765"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106847765"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106847765"}]},"ts":"1690106847765"} 2023-07-23 10:07:27,767 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 4f52f48aa25d4373e33467aee8475710, server=jenkins-hbase4.apache.org,44315,1690106767755}] 2023-07-23 10:07:27,770 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure e294bf40bb6ad660ac3db070121bc27d, server=jenkins-hbase4.apache.org,43301,1690106767667}] 2023-07-23 10:07:27,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 10:07:27,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4f52f48aa25d4373e33467aee8475710 2023-07-23 10:07:27,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4f52f48aa25d4373e33467aee8475710, disabling compactions & flushes 2023-07-23 10:07:27,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710. 2023-07-23 10:07:27,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710. 2023-07-23 10:07:27,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710. after waiting 0 ms 2023-07-23 10:07:27,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710. 2023-07-23 10:07:27,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 4f52f48aa25d4373e33467aee8475710 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-23 10:07:27,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e294bf40bb6ad660ac3db070121bc27d 2023-07-23 10:07:27,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e294bf40bb6ad660ac3db070121bc27d, disabling compactions & flushes 2023-07-23 10:07:27,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d. 2023-07-23 10:07:27,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d. 2023-07-23 10:07:27,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d. after waiting 0 ms 2023-07-23 10:07:27,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d. 2023-07-23 10:07:27,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing e294bf40bb6ad660ac3db070121bc27d 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-23 10:07:27,959 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f52f48aa25d4373e33467aee8475710/.tmp/cf/ef8a14d855fd435089b1dad6a6ea2a20 2023-07-23 10:07:27,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e294bf40bb6ad660ac3db070121bc27d/.tmp/cf/dae72daa47ad4dda8b2175a80b7a8e46 2023-07-23 10:07:27,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f52f48aa25d4373e33467aee8475710/.tmp/cf/ef8a14d855fd435089b1dad6a6ea2a20 as hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f52f48aa25d4373e33467aee8475710/cf/ef8a14d855fd435089b1dad6a6ea2a20 2023-07-23 10:07:27,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e294bf40bb6ad660ac3db070121bc27d/.tmp/cf/dae72daa47ad4dda8b2175a80b7a8e46 as hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e294bf40bb6ad660ac3db070121bc27d/cf/dae72daa47ad4dda8b2175a80b7a8e46 2023-07-23 10:07:27,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e294bf40bb6ad660ac3db070121bc27d/cf/dae72daa47ad4dda8b2175a80b7a8e46, entries=1, sequenceid=5, filesize=4.7 K 2023-07-23 10:07:27,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for e294bf40bb6ad660ac3db070121bc27d in 67ms, sequenceid=5, compaction requested=false 2023-07-23 10:07:27,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-23 10:07:27,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f52f48aa25d4373e33467aee8475710/cf/ef8a14d855fd435089b1dad6a6ea2a20, entries=1, sequenceid=5, filesize=4.7 K 2023-07-23 10:07:27,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 4f52f48aa25d4373e33467aee8475710 in 75ms, sequenceid=5, compaction requested=false 2023-07-23 10:07:28,008 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e294bf40bb6ad660ac3db070121bc27d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-23 10:07:28,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:07:28,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d. 2023-07-23 10:07:28,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e294bf40bb6ad660ac3db070121bc27d: 2023-07-23 10:07:28,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f52f48aa25d4373e33467aee8475710/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-23 10:07:28,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e294bf40bb6ad660ac3db070121bc27d 2023-07-23 10:07:28,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:07:28,012 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=e294bf40bb6ad660ac3db070121bc27d, regionState=CLOSED 2023-07-23 10:07:28,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710. 2023-07-23 10:07:28,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4f52f48aa25d4373e33467aee8475710: 2023-07-23 10:07:28,012 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690106848012"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106848012"}]},"ts":"1690106848012"} 2023-07-23 10:07:28,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4f52f48aa25d4373e33467aee8475710 2023-07-23 10:07:28,017 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=4f52f48aa25d4373e33467aee8475710, regionState=CLOSED 2023-07-23 10:07:28,018 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690106848017"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106848017"}]},"ts":"1690106848017"} 2023-07-23 10:07:28,022 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-23 10:07:28,022 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure e294bf40bb6ad660ac3db070121bc27d, server=jenkins-hbase4.apache.org,43301,1690106767667 in 246 msec 2023-07-23 10:07:28,024 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-23 10:07:28,024 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 4f52f48aa25d4373e33467aee8475710, server=jenkins-hbase4.apache.org,44315,1690106767755 in 253 msec 2023-07-23 10:07:28,027 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e294bf40bb6ad660ac3db070121bc27d, UNASSIGN in 265 msec 2023-07-23 10:07:28,035 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-23 10:07:28,035 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4f52f48aa25d4373e33467aee8475710, UNASSIGN in 263 msec 2023-07-23 10:07:28,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 10:07:28,139 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61ba0125e449adeabfc4ad4a24f48517/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-23 10:07:28,142 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847077.e294bf40bb6ad660ac3db070121bc27d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-23 10:07:28,142 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106847077.4f52f48aa25d4373e33467aee8475710.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-23 10:07:28,142 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-23 10:07:28,227 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=61ba0125e449adeabfc4ad4a24f48517, ASSIGN}] 2023-07-23 10:07:28,230 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=61ba0125e449adeabfc4ad4a24f48517, ASSIGN 2023-07-23 10:07:28,234 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=61ba0125e449adeabfc4ad4a24f48517, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,43301,1690106767667; forceNewPlan=false, retain=false 2023-07-23 10:07:28,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 10:07:28,384 INFO [jenkins-hbase4:39043] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-23 10:07:28,386 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=61ba0125e449adeabfc4ad4a24f48517, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:28,387 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690106848386"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106848386"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106848386"}]},"ts":"1690106848386"} 2023-07-23 10:07:28,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 61ba0125e449adeabfc4ad4a24f48517, server=jenkins-hbase4.apache.org,43301,1690106767667}] 2023-07-23 10:07:28,551 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517. 2023-07-23 10:07:28,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 61ba0125e449adeabfc4ad4a24f48517, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517.', STARTKEY => '', ENDKEY => ''} 2023-07-23 10:07:28,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517. service=AccessControlService 2023-07-23 10:07:28,552 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:07:28,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 61ba0125e449adeabfc4ad4a24f48517 2023-07-23 10:07:28,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:28,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 61ba0125e449adeabfc4ad4a24f48517 2023-07-23 10:07:28,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 61ba0125e449adeabfc4ad4a24f48517 2023-07-23 10:07:28,554 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61ba0125e449adeabfc4ad4a24f48517/.regioninfo 2023-07-23 10:07:28,571 INFO [StoreOpener-61ba0125e449adeabfc4ad4a24f48517-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 61ba0125e449adeabfc4ad4a24f48517 2023-07-23 10:07:28,573 DEBUG [StoreOpener-61ba0125e449adeabfc4ad4a24f48517-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61ba0125e449adeabfc4ad4a24f48517/cf 2023-07-23 10:07:28,573 DEBUG [StoreOpener-61ba0125e449adeabfc4ad4a24f48517-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61ba0125e449adeabfc4ad4a24f48517/cf 2023-07-23 10:07:28,573 INFO [StoreOpener-61ba0125e449adeabfc4ad4a24f48517-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 61ba0125e449adeabfc4ad4a24f48517 columnFamilyName cf 2023-07-23 10:07:28,604 DEBUG [StoreOpener-61ba0125e449adeabfc4ad4a24f48517-1] regionserver.HStore(539): loaded hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61ba0125e449adeabfc4ad4a24f48517/cf/dae72daa47ad4dda8b2175a80b7a8e46.e294bf40bb6ad660ac3db070121bc27d->hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e294bf40bb6ad660ac3db070121bc27d/cf/dae72daa47ad4dda8b2175a80b7a8e46-top 2023-07-23 10:07:28,614 DEBUG [StoreOpener-61ba0125e449adeabfc4ad4a24f48517-1] regionserver.HStore(539): loaded hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61ba0125e449adeabfc4ad4a24f48517/cf/ef8a14d855fd435089b1dad6a6ea2a20.4f52f48aa25d4373e33467aee8475710->hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f52f48aa25d4373e33467aee8475710/cf/ef8a14d855fd435089b1dad6a6ea2a20-top 2023-07-23 10:07:28,619 INFO [StoreOpener-61ba0125e449adeabfc4ad4a24f48517-1] regionserver.HStore(310): Store=61ba0125e449adeabfc4ad4a24f48517/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:07:28,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61ba0125e449adeabfc4ad4a24f48517 2023-07-23 10:07:28,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61ba0125e449adeabfc4ad4a24f48517 2023-07-23 10:07:28,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 61ba0125e449adeabfc4ad4a24f48517 2023-07-23 10:07:28,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 61ba0125e449adeabfc4ad4a24f48517; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75076774, jitterRate=0.11873111128807068}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:07:28,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 61ba0125e449adeabfc4ad4a24f48517: 2023-07-23 10:07:28,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517., pid=77, masterSystemTime=1690106848548 2023-07-23 10:07:28,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517.,because compaction is disabled. 2023-07-23 10:07:28,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517. 2023-07-23 10:07:28,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517. 2023-07-23 10:07:28,630 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=61ba0125e449adeabfc4ad4a24f48517, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:28,630 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690106848630"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106848630"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106848630"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106848630"}]},"ts":"1690106848630"} 2023-07-23 10:07:28,634 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-23 10:07:28,634 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 61ba0125e449adeabfc4ad4a24f48517, server=jenkins-hbase4.apache.org,43301,1690106767667 in 236 msec 2023-07-23 10:07:28,639 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-23 10:07:28,640 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=61ba0125e449adeabfc4ad4a24f48517, ASSIGN in 407 msec 2023-07-23 10:07:28,646 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e294bf40bb6ad660ac3db070121bc27d, 4f52f48aa25d4373e33467aee8475710], force=true in 916 msec 2023-07-23 10:07:28,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 10:07:28,840 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-23 10:07:28,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-23 10:07:28,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106848841 (current time:1690106848841). 2023-07-23 10:07:28,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:07:28,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x4166df1c to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:07:28,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d9edc72, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:07:28,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:28,909 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:28,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4166df1c to 127.0.0.1:61286 2023-07-23 10:07:28,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:07:28,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x1ffdd95a to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:07:28,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68146b86, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:07:28,951 DEBUG [hconnection-0x63e247ba-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:28,955 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:28,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:28,975 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:28,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ffdd95a to 127.0.0.1:61286 2023-07-23 10:07:28,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:07:28,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-23 10:07:28,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:07:28,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-23 10:07:28,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-23 10:07:29,007 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-23 10:07:29,012 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1690107449012 2023-07-23 10:07:29,012 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-23 10:07:29,023 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:07:29,023 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:07:29,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-23 10:07:29,025 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-23 10:07:29,028 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 45 msec 2023-07-23 10:07:29,029 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-23 10:07:29,030 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1690107449030 2023-07-23 10:07:29,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,071 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-23 10:07:29,071 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:29,074 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-23 10:07:29,074 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-23 10:07:29,074 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,075 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,078 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:29,078 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:29,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:29,078 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:29,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:29,078 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:29,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:29,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:29,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:29,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:29,079 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:29,079 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:07:29,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-23 10:07:29,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,080 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-23 10:07:29,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-23 10:07:29,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,081 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-23 10:07:29,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-23 10:07:29,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,081 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-23 10:07:29,087 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,087 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-23 10:07:29,087 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:29,102 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,103 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-23 10:07:29,105 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:29,105 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-23 10:07:29,105 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-23 10:07:29,105 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35943,1690106767812' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-23 10:07:29,108 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,109 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,109 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:29,118 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,118 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-23 10:07:29,118 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:29,120 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-23 10:07:29,120 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-23 10:07:29,120 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-23 10:07:29,120 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-23 10:07:29,120 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-23 10:07:29,120 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44315,1690106767755' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-23 10:07:29,123 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:29,123 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:29,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:29,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:29,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:29,123 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,123 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:29,126 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,126 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:29,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-23 10:07:29,126 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:29,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:07:29,126 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:29,127 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:07:29,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:29,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:29,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:29,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:29,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-23 10:07:29,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f7ea953[Count = 0] remaining members to acquire global barrier 2023-07-23 10:07:29,130 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-23 10:07:29,130 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,137 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,137 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,137 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,138 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-23 10:07:29,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,138 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:29,138 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:07:29,138 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-23 10:07:29,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,138 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-23 10:07:29,138 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-23 10:07:29,138 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35943,1690106767812' in zk 2023-07-23 10:07:29,138 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-23 10:07:29,138 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44315,1690106767755' in zk 2023-07-23 10:07:29,140 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-23 10:07:29,140 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:29,140 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-23 10:07:29,141 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-23 10:07:29,141 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:29,141 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-23 10:07:29,142 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:07:29,142 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:07:29,143 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517. 2023-07-23 10:07:29,157 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517. started... 2023-07-23 10:07:29,159 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 61ba0125e449adeabfc4ad4a24f48517: 2023-07-23 10:07:29,160 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,160 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:07:29,160 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61ba0125e449adeabfc4ad4a24f48517/cf/dae72daa47ad4dda8b2175a80b7a8e46.e294bf40bb6ad660ac3db070121bc27d->hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e294bf40bb6ad660ac3db070121bc27d/cf/dae72daa47ad4dda8b2175a80b7a8e46-top, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61ba0125e449adeabfc4ad4a24f48517/cf/ef8a14d855fd435089b1dad6a6ea2a20.4f52f48aa25d4373e33467aee8475710->hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f52f48aa25d4373e33467aee8475710/cf/ef8a14d855fd435089b1dad6a6ea2a20-top] hfiles 2023-07-23 10:07:29,160 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61ba0125e449adeabfc4ad4a24f48517/cf/dae72daa47ad4dda8b2175a80b7a8e46.e294bf40bb6ad660ac3db070121bc27d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,165 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61ba0125e449adeabfc4ad4a24f48517/cf/ef8a14d855fd435089b1dad6a6ea2a20.4f52f48aa25d4373e33467aee8475710 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,237 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517. completed. 2023-07-23 10:07:29,238 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517. 2023-07-23 10:07:29,238 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:07:29,238 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:07:29,238 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:29,238 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-23 10:07:29,238 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43301,1690106767667' in zk 2023-07-23 10:07:29,247 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:29,247 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-23 10:07:29,247 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:29,247 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-23 10:07:29,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:29,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:29,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:29,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:29,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:29,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:29,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:29,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:29,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:29,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:29,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:29,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:29,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,43301,1690106767667': 2023-07-23 10:07:29,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-23 10:07:29,255 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-23 10:07:29,255 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:07:29,255 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:07:29,255 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,255 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:07:29,259 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,259 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,260 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:29,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:29,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:29,261 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,261 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:29,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,261 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:29,261 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:29,259 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:29,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,262 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,262 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:29,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:29,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:29,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:29,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:29,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:29,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:29,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:29,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:29,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,269 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:29,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:29,269 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:29,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:29,270 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:29,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:29,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:29,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:29,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:29,273 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:29,273 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,273 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:29,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:29,273 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:29,273 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:29,274 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:29,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:29,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:29,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:29,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:29,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:29,274 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:29,274 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:29,274 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,274 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:29,275 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:29,275 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,275 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:29,275 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,275 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:29,275 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:29,275 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,275 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,274 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:29,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:29,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:29,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:29,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-07-23 10:07:29,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:29,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:29,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:29,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:29,327 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:29,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-23 10:07:29,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:07:29,331 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 10:07:29,380 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0004_000001 (auth:SIMPLE) 2023-07-23 10:07:29,456 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,535 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-23 10:07:29,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,535 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,536 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1690106849012Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690106849274 (+262 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690106849274Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690106849296 (+22 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690106849424 (+128 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1690106849535 (+111 ms) 2023-07-23 10:07:29,539 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-23 10:07:29,541 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 520 msec 2023-07-23 10:07:29,631 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:29,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-23 10:07:29,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:07:29,633 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106849633 2023-07-23 10:07:29,633 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39321, tgtDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106849633, rawTgtDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106849633, srcFsUri=hdfs://localhost:39321, srcDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa 2023-07-23 10:07:29,687 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39321, inputRoot=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa 2023-07-23 10:07:29,688 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-658233926_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106849633, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106849633/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,688 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39321, inputRoot=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa, snapshotDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-23 10:07:29,705 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106849633/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:29,807 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:29,807 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:29,808 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:29,808 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:29,809 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:29,809 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:29,809 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:29,930 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/hadoop-6933785816028973721.jar 2023-07-23 10:07:29,930 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:29,931 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:29,931 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:29,931 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:29,932 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:29,932 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:29,933 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 10:07:29,933 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 10:07:29,934 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 10:07:29,934 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 10:07:29,935 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 10:07:29,935 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 10:07:29,936 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 10:07:29,936 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 10:07:29,937 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 10:07:29,937 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 10:07:29,938 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:29,938 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:29,939 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:07:29,939 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:29,940 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:29,940 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:07:29,941 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:07:30,400 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 10:07:30,965 WARN [Listener at jenkins-hbase4.apache.org/44999] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 10:07:30,968 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-23 10:07:30,971 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-23 10:07:31,048 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:07:31,048 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:07:31,252 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0005_000001 (auth:SIMPLE) 2023-07-23 10:07:37,263 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0005_000001 (auth:SIMPLE) 2023-07-23 10:07:39,612 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0005_000001 (auth:SIMPLE) 2023-07-23 10:07:44,710 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0005_000001 (auth:SIMPLE) 2023-07-23 10:07:46,207 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 10:07:46,216 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 10:07:46,227 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,228 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 10:07:46,228 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 10:07:46,229 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-372295689_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,229 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-23 10:07:46,229 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-23 10:07:46,229 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-372295689_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106849633/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106849633/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,230 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106849633/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-23 10:07:46,230 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106849633/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-23 10:07:46,237 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-23 10:07:46,242 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106866242"}]},"ts":"1690106866242"} 2023-07-23 10:07:46,243 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-23 10:07:46,245 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-23 10:07:46,245 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=61ba0125e449adeabfc4ad4a24f48517, UNASSIGN}] 2023-07-23 10:07:46,247 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=61ba0125e449adeabfc4ad4a24f48517, UNASSIGN 2023-07-23 10:07:46,248 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=61ba0125e449adeabfc4ad4a24f48517, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:46,248 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690106866248"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106866248"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106866248"}]},"ts":"1690106866248"} 2023-07-23 10:07:46,251 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 61ba0125e449adeabfc4ad4a24f48517, server=jenkins-hbase4.apache.org,43301,1690106767667}] 2023-07-23 10:07:46,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-23 10:07:46,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 61ba0125e449adeabfc4ad4a24f48517 2023-07-23 10:07:46,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 61ba0125e449adeabfc4ad4a24f48517, disabling compactions & flushes 2023-07-23 10:07:46,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517. 2023-07-23 10:07:46,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517. 2023-07-23 10:07:46,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517. after waiting 0 ms 2023-07-23 10:07:46,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517. 2023-07-23 10:07:46,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61ba0125e449adeabfc4ad4a24f48517/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-23 10:07:46,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:07:46,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517. 2023-07-23 10:07:46,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 61ba0125e449adeabfc4ad4a24f48517: 2023-07-23 10:07:46,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 61ba0125e449adeabfc4ad4a24f48517 2023-07-23 10:07:46,420 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=61ba0125e449adeabfc4ad4a24f48517, regionState=CLOSED 2023-07-23 10:07:46,420 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690106866420"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106866420"}]},"ts":"1690106866420"} 2023-07-23 10:07:46,423 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-23 10:07:46,423 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 61ba0125e449adeabfc4ad4a24f48517, server=jenkins-hbase4.apache.org,43301,1690106767667 in 170 msec 2023-07-23 10:07:46,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-23 10:07:46,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=61ba0125e449adeabfc4ad4a24f48517, UNASSIGN in 178 msec 2023-07-23 10:07:46,427 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106866427"}]},"ts":"1690106866427"} 2023-07-23 10:07:46,429 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-23 10:07:46,432 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-23 10:07:46,437 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 197 msec 2023-07-23 10:07:46,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-23 10:07:46,545 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-23 10:07:46,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,549 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,550 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,551 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,554 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,554 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,554 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,555 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 10:07:46,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 10:07:46,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 10:07:46,556 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 10:07:46,557 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61ba0125e449adeabfc4ad4a24f48517 2023-07-23 10:07:46,557 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,557 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:46,557 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,557 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:46,557 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f52f48aa25d4373e33467aee8475710 2023-07-23 10:07:46,557 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e294bf40bb6ad660ac3db070121bc27d 2023-07-23 10:07:46,558 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:46,558 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,558 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:46,558 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,558 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:46,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-23 10:07:46,558 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:46,559 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:46,559 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:46,561 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61ba0125e449adeabfc4ad4a24f48517/cf, FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61ba0125e449adeabfc4ad4a24f48517/recovered.edits] 2023-07-23 10:07:46,562 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f52f48aa25d4373e33467aee8475710/cf, FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f52f48aa25d4373e33467aee8475710/recovered.edits] 2023-07-23 10:07:46,566 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e294bf40bb6ad660ac3db070121bc27d/cf, FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e294bf40bb6ad660ac3db070121bc27d/recovered.edits] 2023-07-23 10:07:46,572 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61ba0125e449adeabfc4ad4a24f48517/cf/dae72daa47ad4dda8b2175a80b7a8e46.e294bf40bb6ad660ac3db070121bc27d to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61ba0125e449adeabfc4ad4a24f48517/cf/dae72daa47ad4dda8b2175a80b7a8e46.e294bf40bb6ad660ac3db070121bc27d 2023-07-23 10:07:46,572 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f52f48aa25d4373e33467aee8475710/cf/ef8a14d855fd435089b1dad6a6ea2a20 to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f52f48aa25d4373e33467aee8475710/cf/ef8a14d855fd435089b1dad6a6ea2a20 2023-07-23 10:07:46,576 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61ba0125e449adeabfc4ad4a24f48517/cf/ef8a14d855fd435089b1dad6a6ea2a20.4f52f48aa25d4373e33467aee8475710 to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61ba0125e449adeabfc4ad4a24f48517/cf/ef8a14d855fd435089b1dad6a6ea2a20.4f52f48aa25d4373e33467aee8475710 2023-07-23 10:07:46,581 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f52f48aa25d4373e33467aee8475710/recovered.edits/8.seqid to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f52f48aa25d4373e33467aee8475710/recovered.edits/8.seqid 2023-07-23 10:07:46,584 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f52f48aa25d4373e33467aee8475710 2023-07-23 10:07:46,586 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e294bf40bb6ad660ac3db070121bc27d/cf/dae72daa47ad4dda8b2175a80b7a8e46 to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e294bf40bb6ad660ac3db070121bc27d/cf/dae72daa47ad4dda8b2175a80b7a8e46 2023-07-23 10:07:46,589 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61ba0125e449adeabfc4ad4a24f48517/recovered.edits/12.seqid to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61ba0125e449adeabfc4ad4a24f48517/recovered.edits/12.seqid 2023-07-23 10:07:46,591 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61ba0125e449adeabfc4ad4a24f48517 2023-07-23 10:07:46,592 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e294bf40bb6ad660ac3db070121bc27d/recovered.edits/8.seqid to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e294bf40bb6ad660ac3db070121bc27d/recovered.edits/8.seqid 2023-07-23 10:07:46,593 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e294bf40bb6ad660ac3db070121bc27d 2023-07-23 10:07:46,593 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-23 10:07:46,598 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,615 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-23 10:07:46,632 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-23 10:07:46,637 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,637 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-23 10:07:46,637 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106866637"}]},"ts":"9223372036854775807"} 2023-07-23 10:07:46,645 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-23 10:07:46,645 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 61ba0125e449adeabfc4ad4a24f48517, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690106847078.61ba0125e449adeabfc4ad4a24f48517.', STARTKEY => '', ENDKEY => ''}] 2023-07-23 10:07:46,645 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-23 10:07:46,645 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690106866645"}]},"ts":"9223372036854775807"} 2023-07-23 10:07:46,649 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-23 10:07:46,653 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 108 msec 2023-07-23 10:07:46,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-23 10:07:46,660 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-23 10:07:46,661 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,669 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106866668"}]},"ts":"1690106866668"} 2023-07-23 10:07:46,670 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-23 10:07:46,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-23 10:07:46,672 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-23 10:07:46,674 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1a17b0e1bb2b5b3c2629ae18dbf70336, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c54b83919df3df5d0e4b4d6dde1ef4e7, UNASSIGN}] 2023-07-23 10:07:46,677 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1a17b0e1bb2b5b3c2629ae18dbf70336, UNASSIGN 2023-07-23 10:07:46,677 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c54b83919df3df5d0e4b4d6dde1ef4e7, UNASSIGN 2023-07-23 10:07:46,682 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=c54b83919df3df5d0e4b4d6dde1ef4e7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:46,683 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=1a17b0e1bb2b5b3c2629ae18dbf70336, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:46,683 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690106866679"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106866679"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106866679"}]},"ts":"1690106866679"} 2023-07-23 10:07:46,683 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690106866679"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106866679"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106866679"}]},"ts":"1690106866679"} 2023-07-23 10:07:46,685 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure c54b83919df3df5d0e4b4d6dde1ef4e7, server=jenkins-hbase4.apache.org,35943,1690106767812}] 2023-07-23 10:07:46,686 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 1a17b0e1bb2b5b3c2629ae18dbf70336, server=jenkins-hbase4.apache.org,43301,1690106767667}] 2023-07-23 10:07:46,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-23 10:07:46,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c54b83919df3df5d0e4b4d6dde1ef4e7 2023-07-23 10:07:46,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1a17b0e1bb2b5b3c2629ae18dbf70336 2023-07-23 10:07:46,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c54b83919df3df5d0e4b4d6dde1ef4e7, disabling compactions & flushes 2023-07-23 10:07:46,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1a17b0e1bb2b5b3c2629ae18dbf70336, disabling compactions & flushes 2023-07-23 10:07:46,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. 2023-07-23 10:07:46,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. 2023-07-23 10:07:46,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. after waiting 0 ms 2023-07-23 10:07:46,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. 2023-07-23 10:07:46,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7. 2023-07-23 10:07:46,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7. 2023-07-23 10:07:46,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7. after waiting 0 ms 2023-07-23 10:07:46,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7. 2023-07-23 10:07:46,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/c54b83919df3df5d0e4b4d6dde1ef4e7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:07:46,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a17b0e1bb2b5b3c2629ae18dbf70336/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:07:46,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:07:46,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:07:46,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7. 2023-07-23 10:07:46,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c54b83919df3df5d0e4b4d6dde1ef4e7: 2023-07-23 10:07:46,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336. 2023-07-23 10:07:46,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1a17b0e1bb2b5b3c2629ae18dbf70336: 2023-07-23 10:07:46,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c54b83919df3df5d0e4b4d6dde1ef4e7 2023-07-23 10:07:46,879 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=c54b83919df3df5d0e4b4d6dde1ef4e7, regionState=CLOSED 2023-07-23 10:07:46,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1a17b0e1bb2b5b3c2629ae18dbf70336 2023-07-23 10:07:46,879 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690106866879"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106866879"}]},"ts":"1690106866879"} 2023-07-23 10:07:46,880 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=1a17b0e1bb2b5b3c2629ae18dbf70336, regionState=CLOSED 2023-07-23 10:07:46,880 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690106866880"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106866880"}]},"ts":"1690106866880"} 2023-07-23 10:07:46,883 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-23 10:07:46,883 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure c54b83919df3df5d0e4b4d6dde1ef4e7, server=jenkins-hbase4.apache.org,35943,1690106767812 in 197 msec 2023-07-23 10:07:46,884 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-23 10:07:46,884 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 1a17b0e1bb2b5b3c2629ae18dbf70336, server=jenkins-hbase4.apache.org,43301,1690106767667 in 197 msec 2023-07-23 10:07:46,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c54b83919df3df5d0e4b4d6dde1ef4e7, UNASSIGN in 209 msec 2023-07-23 10:07:46,885 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-23 10:07:46,885 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1a17b0e1bb2b5b3c2629ae18dbf70336, UNASSIGN in 210 msec 2023-07-23 10:07:46,886 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106866886"}]},"ts":"1690106866886"} 2023-07-23 10:07:46,887 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-23 10:07:46,890 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-23 10:07:46,891 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 229 msec 2023-07-23 10:07:46,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-23 10:07:46,974 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-23 10:07:46,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,982 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,984 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,984 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,987 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,987 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,987 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,987 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 10:07:46,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 10:07:46,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 10:07:46,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 10:07:46,992 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a17b0e1bb2b5b3c2629ae18dbf70336 2023-07-23 10:07:46,992 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c54b83919df3df5d0e4b4d6dde1ef4e7 2023-07-23 10:07:46,992 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,993 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:46,993 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,993 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,993 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:46,993 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,993 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:46,993 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:46,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-23 10:07:46,994 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a17b0e1bb2b5b3c2629ae18dbf70336/cf, FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a17b0e1bb2b5b3c2629ae18dbf70336/recovered.edits] 2023-07-23 10:07:46,994 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c54b83919df3df5d0e4b4d6dde1ef4e7/cf, FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c54b83919df3df5d0e4b4d6dde1ef4e7/recovered.edits] 2023-07-23 10:07:47,001 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a17b0e1bb2b5b3c2629ae18dbf70336/cf/c4d142ff7aa246fe8a2163c06532fbef to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a17b0e1bb2b5b3c2629ae18dbf70336/cf/c4d142ff7aa246fe8a2163c06532fbef 2023-07-23 10:07:47,001 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c54b83919df3df5d0e4b4d6dde1ef4e7/cf/07ea38ddfcf34104944a7d9326844ca3 to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c54b83919df3df5d0e4b4d6dde1ef4e7/cf/07ea38ddfcf34104944a7d9326844ca3 2023-07-23 10:07:47,004 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a17b0e1bb2b5b3c2629ae18dbf70336/recovered.edits/9.seqid to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a17b0e1bb2b5b3c2629ae18dbf70336/recovered.edits/9.seqid 2023-07-23 10:07:47,004 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c54b83919df3df5d0e4b4d6dde1ef4e7/recovered.edits/9.seqid to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c54b83919df3df5d0e4b4d6dde1ef4e7/recovered.edits/9.seqid 2023-07-23 10:07:47,005 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a17b0e1bb2b5b3c2629ae18dbf70336 2023-07-23 10:07:47,005 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c54b83919df3df5d0e4b4d6dde1ef4e7 2023-07-23 10:07:47,005 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-23 10:07:47,007 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:47,009 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-23 10:07:47,011 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-23 10:07:47,013 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:47,013 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-23 10:07:47,013 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106867013"}]},"ts":"9223372036854775807"} 2023-07-23 10:07:47,013 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106867013"}]},"ts":"9223372036854775807"} 2023-07-23 10:07:47,015 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 10:07:47,015 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1a17b0e1bb2b5b3c2629ae18dbf70336, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690106845049.1a17b0e1bb2b5b3c2629ae18dbf70336.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c54b83919df3df5d0e4b4d6dde1ef4e7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690106845049.c54b83919df3df5d0e4b4d6dde1ef4e7.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 10:07:47,015 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-23 10:07:47,016 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690106867015"}]},"ts":"9223372036854775807"} 2023-07-23 10:07:47,023 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-23 10:07:47,025 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:47,027 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 47 msec 2023-07-23 10:07:47,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-23 10:07:47,096 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-23 10:07:47,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-23 10:07:47,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:47,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-23 10:07:47,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:47,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-23 10:07:47,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:47,141 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=764 (was 748) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:42785 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-372295689_17 at /127.0.0.1:40528 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a736194-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a736194-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-555510314_1 at /127.0.0.1:48108 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a736194-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a736194-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a736194-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-555510314_1 at /127.0.0.1:49268 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-372295689_17 at /127.0.0.1:49294 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4064 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a736194-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-372295689_17 at /127.0.0.1:48136 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=914 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=492 (was 337) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 176) - ProcessCount LEAK? -, AvailableMemoryMB=5590 (was 6961) 2023-07-23 10:07:47,141 WARN [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-23 10:07:47,174 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=764, OpenFileDescriptor=914, MaxFileDescriptor=60000, SystemLoadAverage=492, ProcessCount=179, AvailableMemoryMB=5590 2023-07-23 10:07:47,174 WARN [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-23 10:07:47,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 10:07:47,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 10:07:47,180 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 10:07:47,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-23 10:07:47,181 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 10:07:47,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 10:07:47,183 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2a25f8df45a0797249526b2409f0031 2023-07-23 10:07:47,183 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testEmptyExportFileSystemState/c1a47ea849034f043ac95461634eca36 2023-07-23 10:07:47,184 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2a25f8df45a0797249526b2409f0031 empty. 2023-07-23 10:07:47,184 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testEmptyExportFileSystemState/c1a47ea849034f043ac95461634eca36 empty. 2023-07-23 10:07:47,185 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2a25f8df45a0797249526b2409f0031 2023-07-23 10:07:47,185 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testEmptyExportFileSystemState/c1a47ea849034f043ac95461634eca36 2023-07-23 10:07:47,185 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-23 10:07:47,220 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-23 10:07:47,221 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => c1a47ea849034f043ac95461634eca36, NAME => 'testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp 2023-07-23 10:07:47,222 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => e2a25f8df45a0797249526b2409f0031, NAME => 'testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp 2023-07-23 10:07:47,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 10:07:47,291 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:47,291 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing e2a25f8df45a0797249526b2409f0031, disabling compactions & flushes 2023-07-23 10:07:47,291 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031. 2023-07-23 10:07:47,291 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031. 2023-07-23 10:07:47,291 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031. after waiting 0 ms 2023-07-23 10:07:47,291 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031. 2023-07-23 10:07:47,291 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031. 2023-07-23 10:07:47,292 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for e2a25f8df45a0797249526b2409f0031: 2023-07-23 10:07:47,295 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:47,295 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing c1a47ea849034f043ac95461634eca36, disabling compactions & flushes 2023-07-23 10:07:47,295 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. 2023-07-23 10:07:47,295 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. 2023-07-23 10:07:47,295 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. after waiting 0 ms 2023-07-23 10:07:47,295 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. 2023-07-23 10:07:47,295 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. 2023-07-23 10:07:47,295 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for c1a47ea849034f043ac95461634eca36: 2023-07-23 10:07:47,302 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 10:07:47,303 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690106867303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106867303"}]},"ts":"1690106867303"} 2023-07-23 10:07:47,303 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690106867303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106867303"}]},"ts":"1690106867303"} 2023-07-23 10:07:47,305 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 10:07:47,307 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 10:07:47,307 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106867307"}]},"ts":"1690106867307"} 2023-07-23 10:07:47,309 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-23 10:07:47,313 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 10:07:47,314 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 10:07:47,314 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 10:07:47,314 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 10:07:47,314 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 10:07:47,314 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c1a47ea849034f043ac95461634eca36, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e2a25f8df45a0797249526b2409f0031, ASSIGN}] 2023-07-23 10:07:47,317 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e2a25f8df45a0797249526b2409f0031, ASSIGN 2023-07-23 10:07:47,317 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c1a47ea849034f043ac95461634eca36, ASSIGN 2023-07-23 10:07:47,318 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e2a25f8df45a0797249526b2409f0031, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35943,1690106767812; forceNewPlan=false, retain=false 2023-07-23 10:07:47,318 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c1a47ea849034f043ac95461634eca36, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43301,1690106767667; forceNewPlan=false, retain=false 2023-07-23 10:07:47,468 INFO [jenkins-hbase4:39043] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 10:07:47,471 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=e2a25f8df45a0797249526b2409f0031, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:47,472 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690106867471"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106867471"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106867471"}]},"ts":"1690106867471"} 2023-07-23 10:07:47,472 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=c1a47ea849034f043ac95461634eca36, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:47,472 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690106867472"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106867472"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106867472"}]},"ts":"1690106867472"} 2023-07-23 10:07:47,474 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure e2a25f8df45a0797249526b2409f0031, server=jenkins-hbase4.apache.org,35943,1690106767812}] 2023-07-23 10:07:47,475 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure c1a47ea849034f043ac95461634eca36, server=jenkins-hbase4.apache.org,43301,1690106767667}] 2023-07-23 10:07:47,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 10:07:47,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031. 2023-07-23 10:07:47,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e2a25f8df45a0797249526b2409f0031, NAME => 'testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 10:07:47,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031. service=AccessControlService 2023-07-23 10:07:47,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:07:47,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState e2a25f8df45a0797249526b2409f0031 2023-07-23 10:07:47,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:47,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e2a25f8df45a0797249526b2409f0031 2023-07-23 10:07:47,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e2a25f8df45a0797249526b2409f0031 2023-07-23 10:07:47,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. 2023-07-23 10:07:47,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c1a47ea849034f043ac95461634eca36, NAME => 'testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 10:07:47,635 INFO [StoreOpener-e2a25f8df45a0797249526b2409f0031-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e2a25f8df45a0797249526b2409f0031 2023-07-23 10:07:47,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. service=AccessControlService 2023-07-23 10:07:47,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:07:47,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState c1a47ea849034f043ac95461634eca36 2023-07-23 10:07:47,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:47,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c1a47ea849034f043ac95461634eca36 2023-07-23 10:07:47,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c1a47ea849034f043ac95461634eca36 2023-07-23 10:07:47,637 INFO [StoreOpener-c1a47ea849034f043ac95461634eca36-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c1a47ea849034f043ac95461634eca36 2023-07-23 10:07:47,638 DEBUG [StoreOpener-c1a47ea849034f043ac95461634eca36-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/c1a47ea849034f043ac95461634eca36/cf 2023-07-23 10:07:47,639 DEBUG [StoreOpener-c1a47ea849034f043ac95461634eca36-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/c1a47ea849034f043ac95461634eca36/cf 2023-07-23 10:07:47,639 INFO [StoreOpener-c1a47ea849034f043ac95461634eca36-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c1a47ea849034f043ac95461634eca36 columnFamilyName cf 2023-07-23 10:07:47,640 INFO [StoreOpener-c1a47ea849034f043ac95461634eca36-1] regionserver.HStore(310): Store=c1a47ea849034f043ac95461634eca36/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:07:47,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/c1a47ea849034f043ac95461634eca36 2023-07-23 10:07:47,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/c1a47ea849034f043ac95461634eca36 2023-07-23 10:07:47,643 DEBUG [StoreOpener-e2a25f8df45a0797249526b2409f0031-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/e2a25f8df45a0797249526b2409f0031/cf 2023-07-23 10:07:47,643 DEBUG [StoreOpener-e2a25f8df45a0797249526b2409f0031-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/e2a25f8df45a0797249526b2409f0031/cf 2023-07-23 10:07:47,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c1a47ea849034f043ac95461634eca36 2023-07-23 10:07:47,645 INFO [StoreOpener-e2a25f8df45a0797249526b2409f0031-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2a25f8df45a0797249526b2409f0031 columnFamilyName cf 2023-07-23 10:07:47,646 INFO [StoreOpener-e2a25f8df45a0797249526b2409f0031-1] regionserver.HStore(310): Store=e2a25f8df45a0797249526b2409f0031/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:07:47,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/e2a25f8df45a0797249526b2409f0031 2023-07-23 10:07:47,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/e2a25f8df45a0797249526b2409f0031 2023-07-23 10:07:47,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/c1a47ea849034f043ac95461634eca36/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:07:47,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c1a47ea849034f043ac95461634eca36; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64345964, jitterRate=-0.04117041826248169}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:07:47,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c1a47ea849034f043ac95461634eca36: 2023-07-23 10:07:47,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36., pid=94, masterSystemTime=1690106867632 2023-07-23 10:07:47,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e2a25f8df45a0797249526b2409f0031 2023-07-23 10:07:47,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. 2023-07-23 10:07:47,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. 2023-07-23 10:07:47,651 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=c1a47ea849034f043ac95461634eca36, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:47,651 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690106867651"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106867651"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106867651"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106867651"}]},"ts":"1690106867651"} 2023-07-23 10:07:47,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/e2a25f8df45a0797249526b2409f0031/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:07:47,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e2a25f8df45a0797249526b2409f0031; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74087020, jitterRate=0.10398262739181519}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:07:47,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e2a25f8df45a0797249526b2409f0031: 2023-07-23 10:07:47,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031., pid=93, masterSystemTime=1690106867627 2023-07-23 10:07:47,654 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-23 10:07:47,654 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure c1a47ea849034f043ac95461634eca36, server=jenkins-hbase4.apache.org,43301,1690106767667 in 177 msec 2023-07-23 10:07:47,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031. 2023-07-23 10:07:47,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031. 2023-07-23 10:07:47,655 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=e2a25f8df45a0797249526b2409f0031, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:47,655 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690106867655"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106867655"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106867655"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106867655"}]},"ts":"1690106867655"} 2023-07-23 10:07:47,658 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c1a47ea849034f043ac95461634eca36, ASSIGN in 340 msec 2023-07-23 10:07:47,664 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-23 10:07:47,664 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure e2a25f8df45a0797249526b2409f0031, server=jenkins-hbase4.apache.org,35943,1690106767812 in 185 msec 2023-07-23 10:07:47,667 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-23 10:07:47,667 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e2a25f8df45a0797249526b2409f0031, ASSIGN in 350 msec 2023-07-23 10:07:47,668 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 10:07:47,668 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106867668"}]},"ts":"1690106867668"} 2023-07-23 10:07:47,670 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-23 10:07:47,673 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 10:07:47,673 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-23 10:07:47,675 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 10:07:47,678 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:47,678 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:47,678 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:47,678 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:47,679 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:47,679 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:47,680 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:47,680 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:47,681 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 503 msec 2023-07-23 10:07:47,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 10:07:47,788 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-23 10:07:47,788 DEBUG [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-23 10:07:47,788 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:07:47,795 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-23 10:07:47,795 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:07:47,795 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-23 10:07:47,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:07:47,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106867800 (current time:1690106867800). 2023-07-23 10:07:47,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:07:47,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x41ead8b4 to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:07:47,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68373448, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:07:47,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:47,822 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48286, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:47,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41ead8b4 to 127.0.0.1:61286 2023-07-23 10:07:47,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:07:47,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x3daff05f to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:07:47,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a17b026, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:07:47,851 DEBUG [hconnection-0x7b535458-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:47,855 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48300, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:47,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:47,873 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52660, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:47,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3daff05f to 127.0.0.1:61286 2023-07-23 10:07:47,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:07:47,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 10:07:47,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:07:47,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:07:47,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:07:47,886 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:07:47,887 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690107467887 2023-07-23 10:07:47,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:07:47,887 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-23 10:07:47,888 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:07:47,889 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:07:47,890 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:07:47,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 10:07:47,891 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-23 10:07:47,898 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 10:07:47,899 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690107467899 2023-07-23 10:07:47,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,926 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-23 10:07:47,926 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:47,928 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-23 10:07:47,929 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-23 10:07:47,930 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,930 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,935 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:47,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:47,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:47,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,936 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:47,936 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:47,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:47,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:47,936 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,936 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:47,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,936 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:47,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-23 10:07:47,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,937 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 10:07:47,937 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,937 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:47,937 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:07:47,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-23 10:07:47,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,938 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 10:07:47,938 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:47,938 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:47,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:47,939 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 10:07:47,939 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:47,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-23 10:07:47,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,940 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 10:07:47,941 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,941 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 10:07:47,941 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:47,941 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,941 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 10:07:47,941 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:47,943 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 10:07:47,943 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 10:07:47,943 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 10:07:47,943 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 10:07:47,943 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 10:07:47,943 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 10:07:47,943 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 10:07:47,943 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35943,1690106767812' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 10:07:47,943 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44315,1690106767755' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 10:07:47,945 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:47,945 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:47,945 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:47,945 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:47,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:47,946 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:47,946 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,946 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,946 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:47,946 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:47,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:47,954 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,955 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:47,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:47,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:47,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:47,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:47,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 10:07:47,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17070793[Count = 1] remaining members to acquire global barrier 2023-07-23 10:07:47,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:47,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:47,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:47,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:47,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:47,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:47,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:47,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:47,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:47,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35943,1690106767812' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 10:07:47,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17070793[Count = 0] remaining members to acquire global barrier 2023-07-23 10:07:47,959 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 10:07:47,959 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,962 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,962 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,962 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,962 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:07:47,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,962 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:47,962 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 10:07:47,963 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44315,1690106767755' in zk 2023-07-23 10:07:47,963 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:07:47,963 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:07:47,963 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:47,963 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:07:47,963 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:07:47,963 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:07:47,963 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031. 2023-07-23 10:07:47,963 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031. started... 2023-07-23 10:07:47,964 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 10:07:47,964 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:47,964 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 10:07:47,968 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:07:47,968 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:07:47,968 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. 2023-07-23 10:07:47,969 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. started... 2023-07-23 10:07:47,970 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e2a25f8df45a0797249526b2409f0031: 2023-07-23 10:07:47,970 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c1a47ea849034f043ac95461634eca36: 2023-07-23 10:07:47,971 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,971 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,971 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:07:47,971 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:07:47,971 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:07:47,971 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:07:47,989 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:47,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 10:07:47,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:07:47,990 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:07:48,007 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031. completed. 2023-07-23 10:07:48,007 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031. 2023-07-23 10:07:48,007 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. completed. 2023-07-23 10:07:48,007 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. 2023-07-23 10:07:48,007 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:07:48,007 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:07:48,007 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:07:48,008 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:07:48,008 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,008 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,008 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 10:07:48,008 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 10:07:48,008 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35943,1690106767812' in zk 2023-07-23 10:07:48,008 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43301,1690106767667' in zk 2023-07-23 10:07:48,010 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,010 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:48,010 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 10:07:48,010 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 10:07:48,010 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:48,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:48,010 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 10:07:48,010 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:48,018 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 10:07:48,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:48,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:48,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:48,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:48,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43301,1690106767667': 2023-07-23 10:07:48,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 10:07:48,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:48,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:48,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:48,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:48,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:48,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:48,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:48,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35943,1690106767812': 2023-07-23 10:07:48,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35943,1690106767812' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 10:07:48,027 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-23 10:07:48,027 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:07:48,027 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:07:48,027 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,027 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:07:48,031 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,031 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:48,031 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,031 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,031 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:48,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:48,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:48,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:48,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:48,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:48,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:48,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:48,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,032 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,032 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:48,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,033 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:48,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:48,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:48,035 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:48,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,035 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:48,036 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,039 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,039 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:48,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,041 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:48,041 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:48,041 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-23 10:07:48,041 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:48,041 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:48,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:48,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:48,041 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:48,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:48,041 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:48,042 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:48,042 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:48,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:48,042 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:48,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:48,044 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:48,044 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,044 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,044 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:48,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:48,044 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,044 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,044 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:48,044 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,044 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:48,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:48,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,127 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-23 10:07:48,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,128 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690106867887Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690106868044 (+157 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1690106868044Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1690106868051 (+7 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690106868062 (+11 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690106868127 (+65 ms) 2023-07-23 10:07:48,132 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 10:07:48,134 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 244 msec 2023-07-23 10:07:48,191 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:48,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 10:07:48,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:07:48,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43301] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:07:48,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35943] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:07:48,203 DEBUG [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-23 10:07:48,203 DEBUG [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. 2023-07-23 10:07:48,203 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:07:48,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:07:48,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106868222 (current time:1690106868222). 2023-07-23 10:07:48,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:07:48,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x24c2a587 to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:07:48,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4552d4d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:07:48,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:48,307 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48308, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:48,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24c2a587 to 127.0.0.1:61286 2023-07-23 10:07:48,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:07:48,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x7edd59b3 to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:07:48,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f822572, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:07:48,366 DEBUG [hconnection-0x1c25841d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:48,368 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:48,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:48,374 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:48,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7edd59b3 to 127.0.0.1:61286 2023-07-23 10:07:48,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:07:48,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 10:07:48,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:07:48,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:07:48,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:07:48,380 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:07:48,381 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690107468381 2023-07-23 10:07:48,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:07:48,381 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-23 10:07:48,382 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:07:48,382 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:07:48,383 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:07:48,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 10:07:48,385 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-23 10:07:48,386 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 10:07:48,386 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690107468386 2023-07-23 10:07:48,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,401 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-23 10:07:48,401 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:48,403 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-23 10:07:48,403 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-23 10:07:48,403 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,403 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,431 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:48,432 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:48,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:48,432 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,431 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:48,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:48,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:48,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:48,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:48,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:48,432 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,432 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,433 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,433 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:07:48,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-23 10:07:48,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-23 10:07:48,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,433 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 10:07:48,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-23 10:07:48,433 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 10:07:48,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,433 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,434 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 10:07:48,434 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:48,434 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,434 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 10:07:48,435 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 10:07:48,435 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 10:07:48,435 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 10:07:48,435 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,435 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:48,436 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 10:07:48,435 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44315,1690106767755' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 10:07:48,437 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 10:07:48,437 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 10:07:48,437 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:48,437 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 10:07:48,442 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 10:07:48,443 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 10:07:48,443 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35943,1690106767812' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 10:07:48,462 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,483 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:48,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 10:07:48,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:07:48,484 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:07:48,493 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,493 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,493 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:48,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:48,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:48,493 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,501 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,501 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,501 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:48,501 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:48,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:48,501 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,501 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:48,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:48,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:48,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 10:07:48,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@226e0852[Count = 1] remaining members to acquire global barrier 2023-07-23 10:07:48,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:48,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:48,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:48,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:48,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:48,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:48,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35943,1690106767812' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 10:07:48,506 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 10:07:48,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@226e0852[Count = 0] remaining members to acquire global barrier 2023-07-23 10:07:48,506 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,534 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,534 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,534 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,534 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:07:48,534 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 10:07:48,534 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44315,1690106767755' in zk 2023-07-23 10:07:48,534 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,535 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:07:48,535 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:07:48,535 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:07:48,535 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:07:48,535 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031. 2023-07-23 10:07:48,535 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031. started... 2023-07-23 10:07:48,535 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,535 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:07:48,536 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:07:48,536 INFO [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e2a25f8df45a0797249526b2409f0031 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-23 10:07:48,536 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:07:48,536 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. 2023-07-23 10:07:48,536 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. started... 2023-07-23 10:07:48,536 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c1a47ea849034f043ac95461634eca36 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-23 10:07:48,547 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 10:07:48,547 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:48,547 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 10:07:48,626 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/c1a47ea849034f043ac95461634eca36/.tmp/cf/8f4ae256e4af4ffb8b9d8b640b4033c3 2023-07-23 10:07:48,627 INFO [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/e2a25f8df45a0797249526b2409f0031/.tmp/cf/c073d8d5fcbc4bb9b6a30b61e525c5ad 2023-07-23 10:07:48,634 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/c1a47ea849034f043ac95461634eca36/.tmp/cf/8f4ae256e4af4ffb8b9d8b640b4033c3 as hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/c1a47ea849034f043ac95461634eca36/cf/8f4ae256e4af4ffb8b9d8b640b4033c3 2023-07-23 10:07:48,635 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/e2a25f8df45a0797249526b2409f0031/.tmp/cf/c073d8d5fcbc4bb9b6a30b61e525c5ad as hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/e2a25f8df45a0797249526b2409f0031/cf/c073d8d5fcbc4bb9b6a30b61e525c5ad 2023-07-23 10:07:48,643 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/c1a47ea849034f043ac95461634eca36/cf/8f4ae256e4af4ffb8b9d8b640b4033c3, entries=3, sequenceid=6, filesize=5.0 K 2023-07-23 10:07:48,644 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for c1a47ea849034f043ac95461634eca36 in 108ms, sequenceid=6, compaction requested=false 2023-07-23 10:07:48,644 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-23 10:07:48,645 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c1a47ea849034f043ac95461634eca36: 2023-07-23 10:07:48,645 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,645 INFO [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/e2a25f8df45a0797249526b2409f0031/cf/c073d8d5fcbc4bb9b6a30b61e525c5ad, entries=47, sequenceid=6, filesize=8.0 K 2023-07-23 10:07:48,646 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:07:48,646 INFO [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for e2a25f8df45a0797249526b2409f0031 in 111ms, sequenceid=6, compaction requested=false 2023-07-23 10:07:48,646 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/c1a47ea849034f043ac95461634eca36/cf/8f4ae256e4af4ffb8b9d8b640b4033c3] hfiles 2023-07-23 10:07:48,646 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/c1a47ea849034f043ac95461634eca36/cf/8f4ae256e4af4ffb8b9d8b640b4033c3 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,648 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e2a25f8df45a0797249526b2409f0031: 2023-07-23 10:07:48,648 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,649 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:07:48,649 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/e2a25f8df45a0797249526b2409f0031/cf/c073d8d5fcbc4bb9b6a30b61e525c5ad] hfiles 2023-07-23 10:07:48,649 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/e2a25f8df45a0797249526b2409f0031/cf/c073d8d5fcbc4bb9b6a30b61e525c5ad for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,681 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031. completed. 2023-07-23 10:07:48,681 DEBUG [rs(jenkins-hbase4.apache.org,35943,1690106767812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031. 2023-07-23 10:07:48,681 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:07:48,681 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:07:48,681 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,681 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 10:07:48,681 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35943,1690106767812' in zk 2023-07-23 10:07:48,682 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. completed. 2023-07-23 10:07:48,682 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. 2023-07-23 10:07:48,682 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:07:48,682 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:07:48,682 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,682 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 10:07:48,682 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43301,1690106767667' in zk 2023-07-23 10:07:48,683 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 10:07:48,683 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,683 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:48,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:48,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:48,685 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:48,683 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 10:07:48,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 10:07:48,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:07:48,687 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 10:07:48,687 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 10:07:48,687 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:48,687 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 10:07:48,689 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:48,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:48,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:48,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:48,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:48,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35943,1690106767812': 2023-07-23 10:07:48,693 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35943,1690106767812' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 10:07:48,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:48,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:48,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:48,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:48,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:48,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:48,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:48,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43301,1690106767667': 2023-07-23 10:07:48,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 10:07:48,701 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-23 10:07:48,701 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:07:48,701 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:07:48,701 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,701 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:07:48,704 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,704 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:48,704 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,704 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,704 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,704 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:48,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:48,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:48,704 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:48,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:48,705 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:48,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:48,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:48,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:48,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:48,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,705 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:48,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:48,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,706 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:48,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:48,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,709 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:48,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,709 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:48,710 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:48,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,719 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:48,719 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:48,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:48,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:48,719 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,719 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:48,719 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,719 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,719 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:48,720 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,720 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:07:48,720 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,720 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:07:48,720 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:07:48,720 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,720 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:48,720 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:48,719 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:48,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:48,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:48,720 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:48,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:48,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:48,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:48,720 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,719 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:48,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:48,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:48,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:48,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:48,723 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,749 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,783 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-23 10:07:48,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,783 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690106868381Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1690106868720 (+339 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1690106868720Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1690106868726 (+6 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1690106868740 (+14 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690106868783 (+43 ms) 2023-07-23 10:07:48,787 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 10:07:48,788 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 405 msec 2023-07-23 10:07:48,987 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:48,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 10:07:48,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:07:48,989 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106868989 2023-07-23 10:07:48,989 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39321, tgtDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106868989, rawTgtDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106868989, srcFsUri=hdfs://localhost:39321, srcDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa 2023-07-23 10:07:49,013 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39321, inputRoot=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa 2023-07-23 10:07:49,013 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-241867719_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106868989, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106868989/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:49,013 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39321, inputRoot=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa, snapshotDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-23 10:07:49,021 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106868989/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:49,068 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:49,068 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:49,069 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:49,069 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:49,070 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:49,070 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:49,070 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:49,148 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/hadoop-6519182642316771336.jar 2023-07-23 10:07:49,148 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:49,149 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:49,149 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:49,150 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:49,150 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:49,150 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:49,151 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 10:07:49,152 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 10:07:49,152 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 10:07:49,153 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 10:07:49,153 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 10:07:49,154 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 10:07:49,154 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 10:07:49,155 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 10:07:49,155 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 10:07:49,156 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 10:07:49,156 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:49,156 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:49,157 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:07:49,157 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:49,158 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:49,158 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:07:49,159 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:07:50,326 WARN [Listener at jenkins-hbase4.apache.org/44999] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 10:07:50,329 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-23 10:07:50,845 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:07:50,845 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:07:50,850 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0005_000001 (auth:SIMPLE) 2023-07-23 10:07:51,598 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0006_000001 (auth:SIMPLE) 2023-07-23 10:07:52,033 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 10:07:57,772 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0006_000001 (auth:SIMPLE) 2023-07-23 10:08:00,882 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 10:08:00,885 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 10:08:00,907 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:08:00,907 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 10:08:00,908 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 10:08:00,908 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-372295689_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:08:00,909 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-23 10:08:00,909 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-23 10:08:00,909 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-372295689_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106868989/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106868989/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:08:00,910 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106868989/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-23 10:08:00,910 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106868989/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-23 10:08:00,917 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-23 10:08:00,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-23 10:08:00,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 10:08:00,923 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106880923"}]},"ts":"1690106880923"} 2023-07-23 10:08:00,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-23 10:08:00,927 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-23 10:08:00,930 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-23 10:08:00,931 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c1a47ea849034f043ac95461634eca36, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e2a25f8df45a0797249526b2409f0031, UNASSIGN}] 2023-07-23 10:08:00,932 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c1a47ea849034f043ac95461634eca36, UNASSIGN 2023-07-23 10:08:00,938 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e2a25f8df45a0797249526b2409f0031, UNASSIGN 2023-07-23 10:08:00,939 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=e2a25f8df45a0797249526b2409f0031, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:00,939 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=c1a47ea849034f043ac95461634eca36, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:00,939 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690106880939"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106880939"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106880939"}]},"ts":"1690106880939"} 2023-07-23 10:08:00,939 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690106880939"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106880939"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106880939"}]},"ts":"1690106880939"} 2023-07-23 10:08:00,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure e2a25f8df45a0797249526b2409f0031, server=jenkins-hbase4.apache.org,35943,1690106767812}] 2023-07-23 10:08:00,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure c1a47ea849034f043ac95461634eca36, server=jenkins-hbase4.apache.org,43301,1690106767667}] 2023-07-23 10:08:01,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-23 10:08:01,096 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e2a25f8df45a0797249526b2409f0031 2023-07-23 10:08:01,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e2a25f8df45a0797249526b2409f0031, disabling compactions & flushes 2023-07-23 10:08:01,096 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031. 2023-07-23 10:08:01,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031. 2023-07-23 10:08:01,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031. after waiting 0 ms 2023-07-23 10:08:01,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031. 2023-07-23 10:08:01,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c1a47ea849034f043ac95461634eca36 2023-07-23 10:08:01,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c1a47ea849034f043ac95461634eca36, disabling compactions & flushes 2023-07-23 10:08:01,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. 2023-07-23 10:08:01,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. 2023-07-23 10:08:01,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. after waiting 0 ms 2023-07-23 10:08:01,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. 2023-07-23 10:08:01,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/e2a25f8df45a0797249526b2409f0031/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:08:01,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:08:01,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031. 2023-07-23 10:08:01,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e2a25f8df45a0797249526b2409f0031: 2023-07-23 10:08:01,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e2a25f8df45a0797249526b2409f0031 2023-07-23 10:08:01,136 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=e2a25f8df45a0797249526b2409f0031, regionState=CLOSED 2023-07-23 10:08:01,136 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690106881136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106881136"}]},"ts":"1690106881136"} 2023-07-23 10:08:01,144 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-23 10:08:01,144 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure e2a25f8df45a0797249526b2409f0031, server=jenkins-hbase4.apache.org,35943,1690106767812 in 197 msec 2023-07-23 10:08:01,146 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e2a25f8df45a0797249526b2409f0031, UNASSIGN in 213 msec 2023-07-23 10:08:01,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testEmptyExportFileSystemState/c1a47ea849034f043ac95461634eca36/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:08:01,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:08:01,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36. 2023-07-23 10:08:01,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c1a47ea849034f043ac95461634eca36: 2023-07-23 10:08:01,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c1a47ea849034f043ac95461634eca36 2023-07-23 10:08:01,156 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=c1a47ea849034f043ac95461634eca36, regionState=CLOSED 2023-07-23 10:08:01,156 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690106881156"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106881156"}]},"ts":"1690106881156"} 2023-07-23 10:08:01,163 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-23 10:08:01,163 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure c1a47ea849034f043ac95461634eca36, server=jenkins-hbase4.apache.org,43301,1690106767667 in 213 msec 2023-07-23 10:08:01,165 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-23 10:08:01,165 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c1a47ea849034f043ac95461634eca36, UNASSIGN in 232 msec 2023-07-23 10:08:01,166 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106881166"}]},"ts":"1690106881166"} 2023-07-23 10:08:01,167 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-23 10:08:01,169 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-23 10:08:01,172 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 252 msec 2023-07-23 10:08:01,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-23 10:08:01,226 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-23 10:08:01,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,234 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,235 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,237 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,241 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,241 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,241 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,242 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,242 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-23 10:08:01,242 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-23 10:08:01,243 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-23 10:08:01,243 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-23 10:08:01,243 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2a25f8df45a0797249526b2409f0031 2023-07-23 10:08:01,243 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testEmptyExportFileSystemState/c1a47ea849034f043ac95461634eca36 2023-07-23 10:08:01,244 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,244 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:01,244 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,244 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:01,244 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,244 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:01,244 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,244 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:01,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-23 10:08:01,258 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2a25f8df45a0797249526b2409f0031/cf, FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2a25f8df45a0797249526b2409f0031/recovered.edits] 2023-07-23 10:08:01,259 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testEmptyExportFileSystemState/c1a47ea849034f043ac95461634eca36/cf, FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testEmptyExportFileSystemState/c1a47ea849034f043ac95461634eca36/recovered.edits] 2023-07-23 10:08:01,274 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testEmptyExportFileSystemState/c1a47ea849034f043ac95461634eca36/cf/8f4ae256e4af4ffb8b9d8b640b4033c3 to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testEmptyExportFileSystemState/c1a47ea849034f043ac95461634eca36/cf/8f4ae256e4af4ffb8b9d8b640b4033c3 2023-07-23 10:08:01,276 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2a25f8df45a0797249526b2409f0031/cf/c073d8d5fcbc4bb9b6a30b61e525c5ad to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testEmptyExportFileSystemState/e2a25f8df45a0797249526b2409f0031/cf/c073d8d5fcbc4bb9b6a30b61e525c5ad 2023-07-23 10:08:01,281 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2a25f8df45a0797249526b2409f0031/recovered.edits/9.seqid to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testEmptyExportFileSystemState/e2a25f8df45a0797249526b2409f0031/recovered.edits/9.seqid 2023-07-23 10:08:01,283 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testEmptyExportFileSystemState/c1a47ea849034f043ac95461634eca36/recovered.edits/9.seqid to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testEmptyExportFileSystemState/c1a47ea849034f043ac95461634eca36/recovered.edits/9.seqid 2023-07-23 10:08:01,283 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2a25f8df45a0797249526b2409f0031 2023-07-23 10:08:01,283 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testEmptyExportFileSystemState/c1a47ea849034f043ac95461634eca36 2023-07-23 10:08:01,283 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-23 10:08:01,286 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,305 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-23 10:08:01,309 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-23 10:08:01,310 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,310 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-23 10:08:01,311 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106881310"}]},"ts":"9223372036854775807"} 2023-07-23 10:08:01,311 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106881310"}]},"ts":"9223372036854775807"} 2023-07-23 10:08:01,313 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 10:08:01,313 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c1a47ea849034f043ac95461634eca36, NAME => 'testtb-testEmptyExportFileSystemState,,1690106867175.c1a47ea849034f043ac95461634eca36.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e2a25f8df45a0797249526b2409f0031, NAME => 'testtb-testEmptyExportFileSystemState,1,1690106867175.e2a25f8df45a0797249526b2409f0031.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 10:08:01,313 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-23 10:08:01,313 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690106881313"}]},"ts":"9223372036854775807"} 2023-07-23 10:08:01,317 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-23 10:08:01,320 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,321 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 93 msec 2023-07-23 10:08:01,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-23 10:08:01,347 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-23 10:08:01,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-23 10:08:01,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:08:01,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-23 10:08:01,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-23 10:08:01,396 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 764) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:41001 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-372295689_17 at /127.0.0.1:44322 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_500800125_1 at /127.0.0.1:34154 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a736194-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_500800125_1 at /127.0.0.1:43792 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a736194-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:44041 from appattempt_1690106776904_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4835 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-372295689_17 at /127.0.0.1:45900 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-372295689_17 at /127.0.0.1:34142 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a736194-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a736194-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=909 (was 914), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=575 (was 492) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=5043 (was 5590) 2023-07-23 10:08:01,396 WARN [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-23 10:08:01,425 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=909, MaxFileDescriptor=60000, SystemLoadAverage=575, ProcessCount=180, AvailableMemoryMB=5042 2023-07-23 10:08:01,425 WARN [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-23 10:08:01,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 10:08:01,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:01,432 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 10:08:01,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-23 10:08:01,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 10:08:01,439 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 10:08:01,443 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/eaec5127012c2c2cfd6a4c89e468485c 2023-07-23 10:08:01,443 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9d87894eb41d30529b5722847d9b2f8 2023-07-23 10:08:01,444 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/eaec5127012c2c2cfd6a4c89e468485c empty. 2023-07-23 10:08:01,444 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9d87894eb41d30529b5722847d9b2f8 empty. 2023-07-23 10:08:01,445 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/eaec5127012c2c2cfd6a4c89e468485c 2023-07-23 10:08:01,445 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9d87894eb41d30529b5722847d9b2f8 2023-07-23 10:08:01,446 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-23 10:08:01,467 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-23 10:08:01,469 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => eaec5127012c2c2cfd6a4c89e468485c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp 2023-07-23 10:08:01,469 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => e9d87894eb41d30529b5722847d9b2f8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp 2023-07-23 10:08:01,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 10:08:01,552 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:08:01,552 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing eaec5127012c2c2cfd6a4c89e468485c, disabling compactions & flushes 2023-07-23 10:08:01,552 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. 2023-07-23 10:08:01,552 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. 2023-07-23 10:08:01,552 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. after waiting 0 ms 2023-07-23 10:08:01,552 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. 2023-07-23 10:08:01,552 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. 2023-07-23 10:08:01,552 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for eaec5127012c2c2cfd6a4c89e468485c: 2023-07-23 10:08:01,553 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:08:01,553 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing e9d87894eb41d30529b5722847d9b2f8, disabling compactions & flushes 2023-07-23 10:08:01,554 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8. 2023-07-23 10:08:01,554 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8. 2023-07-23 10:08:01,554 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8. after waiting 0 ms 2023-07-23 10:08:01,554 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8. 2023-07-23 10:08:01,554 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8. 2023-07-23 10:08:01,554 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for e9d87894eb41d30529b5722847d9b2f8: 2023-07-23 10:08:01,557 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 10:08:01,558 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690106881557"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106881557"}]},"ts":"1690106881557"} 2023-07-23 10:08:01,558 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690106881557"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106881557"}]},"ts":"1690106881557"} 2023-07-23 10:08:01,560 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 10:08:01,561 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 10:08:01,562 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106881561"}]},"ts":"1690106881561"} 2023-07-23 10:08:01,563 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-23 10:08:01,567 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 10:08:01,568 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 10:08:01,568 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 10:08:01,568 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 10:08:01,568 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 10:08:01,568 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=eaec5127012c2c2cfd6a4c89e468485c, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e9d87894eb41d30529b5722847d9b2f8, ASSIGN}] 2023-07-23 10:08:01,572 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e9d87894eb41d30529b5722847d9b2f8, ASSIGN 2023-07-23 10:08:01,572 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=eaec5127012c2c2cfd6a4c89e468485c, ASSIGN 2023-07-23 10:08:01,573 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e9d87894eb41d30529b5722847d9b2f8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44315,1690106767755; forceNewPlan=false, retain=false 2023-07-23 10:08:01,574 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=eaec5127012c2c2cfd6a4c89e468485c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43301,1690106767667; forceNewPlan=false, retain=false 2023-07-23 10:08:01,723 INFO [jenkins-hbase4:39043] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 10:08:01,727 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=eaec5127012c2c2cfd6a4c89e468485c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:01,727 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=e9d87894eb41d30529b5722847d9b2f8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:01,727 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690106881727"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106881727"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106881727"}]},"ts":"1690106881727"} 2023-07-23 10:08:01,727 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690106881727"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106881727"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106881727"}]},"ts":"1690106881727"} 2023-07-23 10:08:01,729 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure eaec5127012c2c2cfd6a4c89e468485c, server=jenkins-hbase4.apache.org,43301,1690106767667}] 2023-07-23 10:08:01,730 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure e9d87894eb41d30529b5722847d9b2f8, server=jenkins-hbase4.apache.org,44315,1690106767755}] 2023-07-23 10:08:01,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 10:08:01,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. 2023-07-23 10:08:01,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eaec5127012c2c2cfd6a4c89e468485c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 10:08:01,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. service=AccessControlService 2023-07-23 10:08:01,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:08:01,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp eaec5127012c2c2cfd6a4c89e468485c 2023-07-23 10:08:01,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:08:01,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for eaec5127012c2c2cfd6a4c89e468485c 2023-07-23 10:08:01,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for eaec5127012c2c2cfd6a4c89e468485c 2023-07-23 10:08:01,901 INFO [StoreOpener-eaec5127012c2c2cfd6a4c89e468485c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region eaec5127012c2c2cfd6a4c89e468485c 2023-07-23 10:08:01,904 DEBUG [StoreOpener-eaec5127012c2c2cfd6a4c89e468485c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/eaec5127012c2c2cfd6a4c89e468485c/cf 2023-07-23 10:08:01,904 DEBUG [StoreOpener-eaec5127012c2c2cfd6a4c89e468485c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/eaec5127012c2c2cfd6a4c89e468485c/cf 2023-07-23 10:08:01,905 INFO [StoreOpener-eaec5127012c2c2cfd6a4c89e468485c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eaec5127012c2c2cfd6a4c89e468485c columnFamilyName cf 2023-07-23 10:08:01,905 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8. 2023-07-23 10:08:01,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e9d87894eb41d30529b5722847d9b2f8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 10:08:01,905 INFO [StoreOpener-eaec5127012c2c2cfd6a4c89e468485c-1] regionserver.HStore(310): Store=eaec5127012c2c2cfd6a4c89e468485c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:08:01,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8. service=AccessControlService 2023-07-23 10:08:01,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:08:01,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp e9d87894eb41d30529b5722847d9b2f8 2023-07-23 10:08:01,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:08:01,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e9d87894eb41d30529b5722847d9b2f8 2023-07-23 10:08:01,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e9d87894eb41d30529b5722847d9b2f8 2023-07-23 10:08:01,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/eaec5127012c2c2cfd6a4c89e468485c 2023-07-23 10:08:01,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/eaec5127012c2c2cfd6a4c89e468485c 2023-07-23 10:08:01,908 INFO [StoreOpener-e9d87894eb41d30529b5722847d9b2f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e9d87894eb41d30529b5722847d9b2f8 2023-07-23 10:08:01,910 DEBUG [StoreOpener-e9d87894eb41d30529b5722847d9b2f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9d87894eb41d30529b5722847d9b2f8/cf 2023-07-23 10:08:01,910 DEBUG [StoreOpener-e9d87894eb41d30529b5722847d9b2f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9d87894eb41d30529b5722847d9b2f8/cf 2023-07-23 10:08:01,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for eaec5127012c2c2cfd6a4c89e468485c 2023-07-23 10:08:01,911 INFO [StoreOpener-e9d87894eb41d30529b5722847d9b2f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9d87894eb41d30529b5722847d9b2f8 columnFamilyName cf 2023-07-23 10:08:01,911 INFO [StoreOpener-e9d87894eb41d30529b5722847d9b2f8-1] regionserver.HStore(310): Store=e9d87894eb41d30529b5722847d9b2f8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:08:01,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9d87894eb41d30529b5722847d9b2f8 2023-07-23 10:08:01,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9d87894eb41d30529b5722847d9b2f8 2023-07-23 10:08:01,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/eaec5127012c2c2cfd6a4c89e468485c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:08:01,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened eaec5127012c2c2cfd6a4c89e468485c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61339915, jitterRate=-0.08596403896808624}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:08:01,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for eaec5127012c2c2cfd6a4c89e468485c: 2023-07-23 10:08:01,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c., pid=108, masterSystemTime=1690106881882 2023-07-23 10:08:01,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e9d87894eb41d30529b5722847d9b2f8 2023-07-23 10:08:01,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. 2023-07-23 10:08:01,922 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. 2023-07-23 10:08:01,922 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=eaec5127012c2c2cfd6a4c89e468485c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:01,923 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690106881922"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106881922"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106881922"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106881922"}]},"ts":"1690106881922"} 2023-07-23 10:08:01,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9d87894eb41d30529b5722847d9b2f8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:08:01,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e9d87894eb41d30529b5722847d9b2f8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66276238, jitterRate=-0.012407094240188599}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:08:01,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e9d87894eb41d30529b5722847d9b2f8: 2023-07-23 10:08:01,929 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-23 10:08:01,929 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure eaec5127012c2c2cfd6a4c89e468485c, server=jenkins-hbase4.apache.org,43301,1690106767667 in 197 msec 2023-07-23 10:08:01,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8., pid=109, masterSystemTime=1690106881882 2023-07-23 10:08:01,931 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=eaec5127012c2c2cfd6a4c89e468485c, ASSIGN in 361 msec 2023-07-23 10:08:01,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8. 2023-07-23 10:08:01,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8. 2023-07-23 10:08:01,933 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=e9d87894eb41d30529b5722847d9b2f8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:01,933 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690106881932"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106881932"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106881932"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106881932"}]},"ts":"1690106881932"} 2023-07-23 10:08:01,937 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-23 10:08:01,937 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure e9d87894eb41d30529b5722847d9b2f8, server=jenkins-hbase4.apache.org,44315,1690106767755 in 205 msec 2023-07-23 10:08:01,941 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-23 10:08:01,941 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e9d87894eb41d30529b5722847d9b2f8, ASSIGN in 369 msec 2023-07-23 10:08:01,942 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 10:08:01,942 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106881942"}]},"ts":"1690106881942"} 2023-07-23 10:08:01,945 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-23 10:08:01,948 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 10:08:01,949 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-23 10:08:01,951 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-23 10:08:01,953 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:01,953 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:01,953 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:01,953 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:01,956 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 10:08:01,956 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 10:08:01,956 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 10:08:01,957 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 10:08:01,958 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 528 msec 2023-07-23 10:08:02,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 10:08:02,048 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-23 10:08:02,048 DEBUG [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-23 10:08:02,048 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:08:02,054 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-23 10:08:02,054 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:08:02,054 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-23 10:08:02,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 10:08:02,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106882062 (current time:1690106882062). 2023-07-23 10:08:02,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:08:02,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x02dc2087 to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:08:02,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3445dea2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:08:02,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:08:02,115 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58196, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:08:02,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02dc2087 to 127.0.0.1:61286 2023-07-23 10:08:02,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:02,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x7f36eec8 to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:08:02,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c8d31b1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:08:02,130 DEBUG [hconnection-0x6a75c4c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:08:02,135 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58202, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:08:02,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:08:02,143 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59866, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:08:02,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f36eec8 to 127.0.0.1:61286 2023-07-23 10:08:02,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:02,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-23 10:08:02,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:08:02,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 10:08:02,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 10:08:02,160 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 10:08:02,160 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690107482160 2023-07-23 10:08:02,160 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 10:08:02,161 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:08:02,161 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:08:02,165 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 10:08:02,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 10:08:02,169 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 11 msec 2023-07-23 10:08:02,171 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 10:08:02,178 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690107482178 2023-07-23 10:08:02,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,219 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-23 10:08:02,220 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:08:02,221 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-23 10:08:02,221 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-23 10:08:02,254 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,254 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,257 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:02,257 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,257 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:02,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:02,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:02,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:02,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:02,258 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,258 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,258 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,258 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:08:02,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-23 10:08:02,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,259 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 10:08:02,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,259 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:02,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:02,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:02,259 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,260 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 10:08:02,260 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:08:02,261 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:08:02,261 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 10:08:02,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-23 10:08:02,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,261 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 10:08:02,262 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35943,1690106767812' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 10:08:02,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,262 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 10:08:02,262 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 10:08:02,262 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 10:08:02,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:08:02,263 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:08:02,263 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:08:02,265 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 10:08:02,265 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 10:08:02,265 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 10:08:02,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,269 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-23 10:08:02,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,270 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 10:08:02,270 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,270 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 10:08:02,270 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:08:02,272 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 10:08:02,272 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 10:08:02,272 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44315,1690106767755' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 10:08:02,272 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,272 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,272 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,272 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:08:02,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:08:02,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:08:02,273 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,273 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:08:02,277 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:08:02,277 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:08:02,278 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,278 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:08:02,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:02,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:08:02,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 10:08:02,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54c2d998[Count = 1] remaining members to acquire global barrier 2023-07-23 10:08:02,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:08:02,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:08:02,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:08:02,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:08:02,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:02,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:08:02,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44315,1690106767755' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 10:08:02,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54c2d998[Count = 0] remaining members to acquire global barrier 2023-07-23 10:08:02,284 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-23 10:08:02,285 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,286 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,286 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,286 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,286 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 10:08:02,286 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 10:08:02,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,287 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 10:08:02,287 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 10:08:02,287 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35943,1690106767812' in zk 2023-07-23 10:08:02,291 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,292 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,292 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:08:02,292 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 10:08:02,292 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:08:02,292 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 10:08:02,294 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:08:02,294 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:08:02,294 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8. 2023-07-23 10:08:02,295 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8. started... 2023-07-23 10:08:02,296 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:08:02,296 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:08:02,296 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. 2023-07-23 10:08:02,296 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e9d87894eb41d30529b5722847d9b2f8: 2023-07-23 10:08:02,296 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. started... 2023-07-23 10:08:02,298 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,298 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eaec5127012c2c2cfd6a4c89e468485c: 2023-07-23 10:08:02,298 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:08:02,298 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:08:02,298 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,298 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:08:02,298 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:08:02,311 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. completed. 2023-07-23 10:08:02,311 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. 2023-07-23 10:08:02,311 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:08:02,311 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:08:02,311 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,313 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 10:08:02,313 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43301,1690106767667' in zk 2023-07-23 10:08:02,315 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 10:08:02,315 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:08:02,315 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,315 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 10:08:02,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:08:02,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:08:02,317 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8. completed. 2023-07-23 10:08:02,317 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8. 2023-07-23 10:08:02,317 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:08:02,317 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:08:02,317 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,317 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 10:08:02,317 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44315,1690106767755' in zk 2023-07-23 10:08:02,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:08:02,319 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:08:02,319 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 10:08:02,319 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:08:02,319 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 10:08:02,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:02,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:08:02,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:02,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43301,1690106767667': 2023-07-23 10:08:02,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-23 10:08:02,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:08:02,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:08:02,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:08:02,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:08:02,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:02,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:08:02,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:02,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44315,1690106767755': 2023-07-23 10:08:02,335 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44315,1690106767755' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-23 10:08:02,335 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-23 10:08:02,335 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:08:02,335 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:08:02,335 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,335 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:08:02,337 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,337 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:08:02,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:08:02,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,337 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:02,337 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,337 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:02,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:08:02,338 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,338 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:08:02,340 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:02,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:02,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:08:02,343 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,343 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,343 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:02,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,343 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:02,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:02,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:02,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:02,344 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:02,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:02,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:02,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:02,349 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:02,349 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,349 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,349 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,349 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,349 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:02,349 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,349 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,349 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,349 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,349 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,349 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:08:02,349 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,350 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:02,350 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:02,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:02,350 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:02,350 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:02,352 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:02,352 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:02,352 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:02,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:02,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:02,353 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:02,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:02,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:02,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:02,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:02,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:02,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:02,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:02,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,432 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-23 10:08:02,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,432 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690106882161Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690106882350 (+189 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690106882350Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690106882358 (+8 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690106882388 (+30 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690106882432 (+44 ms) 2023-07-23 10:08:02,436 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 10:08:02,439 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 273 msec 2023-07-23 10:08:02,463 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:08:02,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 10:08:02,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:08:02,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44315] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:08:02,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43301] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:08:02,491 DEBUG [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,491 DEBUG [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. 2023-07-23 10:08:02,492 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:08:02,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 10:08:02,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106882511 (current time:1690106882511). 2023-07-23 10:08:02,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:08:02,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x5199c628 to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:08:02,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6de0a56b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:08:02,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:08:02,524 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:08:02,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5199c628 to 127.0.0.1:61286 2023-07-23 10:08:02,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:02,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(139): Connect 0x62f8082f to 127.0.0.1:61286 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:08:02,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d4f3ade, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:08:02,544 DEBUG [hconnection-0x156c13e1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:08:02,548 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:08:02,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:08:02,558 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59878, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:08:02,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62f8082f to 127.0.0.1:61286 2023-07-23 10:08:02,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:02,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-23 10:08:02,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:08:02,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 10:08:02,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 10:08:02,568 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 10:08:02,575 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690107482575 2023-07-23 10:08:02,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 10:08:02,575 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,577 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:08:02,577 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:08:02,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 10:08:02,579 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 10:08:02,581 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 14 msec 2023-07-23 10:08:02,583 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 10:08:02,583 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690107482583 2023-07-23 10:08:02,621 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,621 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-23 10:08:02,621 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:08:02,623 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-23 10:08:02,623 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-23 10:08:02,624 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,624 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,626 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:02,626 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:02,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:02,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:02,627 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,626 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:02,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,627 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,628 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-23 10:08:02,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,629 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 10:08:02,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-23 10:08:02,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-23 10:08:02,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,646 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 10:08:02,628 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,647 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:08:02,646 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,647 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,647 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 10:08:02,647 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:08:02,647 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 10:08:02,647 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 10:08:02,647 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:08:02,647 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,649 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 10:08:02,649 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 10:08:02,649 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 10:08:02,649 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 10:08:02,649 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 10:08:02,649 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 10:08:02,649 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44315,1690106767755' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 10:08:02,649 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:08:02,650 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 10:08:02,650 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 10:08:02,650 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35943,1690106767812' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 10:08:02,652 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,652 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:08:02,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:08:02,653 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,653 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,653 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:08:02,653 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,653 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:08:02,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:08:02,653 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,653 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:08:02,653 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,654 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:08:02,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:02,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:08:02,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43301,1690106767667' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 10:08:02,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6eccc662[Count = 1] remaining members to acquire global barrier 2023-07-23 10:08:02,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:08:02,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:08:02,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:08:02,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:08:02,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:02,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:08:02,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44315,1690106767755' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 10:08:02,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6eccc662[Count = 0] remaining members to acquire global barrier 2023-07-23 10:08:02,660 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-23 10:08:02,660 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,665 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,665 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,665 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,666 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 10:08:02,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,666 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 10:08:02,666 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 10:08:02,666 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35943,1690106767812' in zk 2023-07-23 10:08:02,666 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 10:08:02,666 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:08:02,666 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,666 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. 2023-07-23 10:08:02,666 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:08:02,666 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. started... 2023-07-23 10:08:02,667 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2745): Flushing eaec5127012c2c2cfd6a4c89e468485c 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-23 10:08:02,667 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,667 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:08:02,668 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 10:08:02,668 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:08:02,668 DEBUG [member: 'jenkins-hbase4.apache.org,35943,1690106767812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 10:08:02,677 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:08:02,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 10:08:02,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:08:02,679 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:08:02,682 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:08:02,684 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:08:02,684 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8. 2023-07-23 10:08:02,684 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8. started... 2023-07-23 10:08:02,685 INFO [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e9d87894eb41d30529b5722847d9b2f8 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-23 10:08:02,736 INFO [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9d87894eb41d30529b5722847d9b2f8/.tmp/cf/d8806ef984684b8784701b700f13ef33 2023-07-23 10:08:02,750 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/eaec5127012c2c2cfd6a4c89e468485c/.tmp/cf/335c559aff404852ae9f8b4c493e36bc 2023-07-23 10:08:02,759 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/eaec5127012c2c2cfd6a4c89e468485c/.tmp/cf/335c559aff404852ae9f8b4c493e36bc as hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/eaec5127012c2c2cfd6a4c89e468485c/cf/335c559aff404852ae9f8b4c493e36bc 2023-07-23 10:08:02,763 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9d87894eb41d30529b5722847d9b2f8/.tmp/cf/d8806ef984684b8784701b700f13ef33 as hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9d87894eb41d30529b5722847d9b2f8/cf/d8806ef984684b8784701b700f13ef33 2023-07-23 10:08:02,764 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/eaec5127012c2c2cfd6a4c89e468485c/cf/335c559aff404852ae9f8b4c493e36bc, entries=4, sequenceid=6, filesize=5.1 K 2023-07-23 10:08:02,765 INFO [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for eaec5127012c2c2cfd6a4c89e468485c in 99ms, sequenceid=6, compaction requested=false 2023-07-23 10:08:02,765 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-23 10:08:02,766 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eaec5127012c2c2cfd6a4c89e468485c: 2023-07-23 10:08:02,766 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,766 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:08:02,766 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/eaec5127012c2c2cfd6a4c89e468485c/cf/335c559aff404852ae9f8b4c493e36bc] hfiles 2023-07-23 10:08:02,766 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/eaec5127012c2c2cfd6a4c89e468485c/cf/335c559aff404852ae9f8b4c493e36bc for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,775 INFO [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9d87894eb41d30529b5722847d9b2f8/cf/d8806ef984684b8784701b700f13ef33, entries=46, sequenceid=6, filesize=7.9 K 2023-07-23 10:08:02,777 INFO [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for e9d87894eb41d30529b5722847d9b2f8 in 92ms, sequenceid=6, compaction requested=false 2023-07-23 10:08:02,786 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e9d87894eb41d30529b5722847d9b2f8: 2023-07-23 10:08:02,786 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,786 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:08:02,786 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9d87894eb41d30529b5722847d9b2f8/cf/d8806ef984684b8784701b700f13ef33] hfiles 2023-07-23 10:08:02,786 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9d87894eb41d30529b5722847d9b2f8/cf/d8806ef984684b8784701b700f13ef33 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,810 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8. completed. 2023-07-23 10:08:02,811 DEBUG [rs(jenkins-hbase4.apache.org,44315,1690106767755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8. 2023-07-23 10:08:02,811 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:08:02,811 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:08:02,811 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,811 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 10:08:02,811 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44315,1690106767755' in zk 2023-07-23 10:08:02,813 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 10:08:02,813 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,813 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:08:02,813 DEBUG [member: 'jenkins-hbase4.apache.org,44315,1690106767755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 10:08:02,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:08:02,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:08:02,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:08:02,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:08:02,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:02,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:02,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:08:02,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:02,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:02,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44315,1690106767755': 2023-07-23 10:08:02,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44315,1690106767755' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-23 10:08:02,879 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:08:02,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 10:08:02,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:08:02,881 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 10:08:03,181 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:08:03,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 10:08:03,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:08:03,183 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-23 10:08:03,211 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. completed. 2023-07-23 10:08:03,211 DEBUG [rs(jenkins-hbase4.apache.org,43301,1690106767667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. 2023-07-23 10:08:03,211 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:08:03,211 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:08:03,211 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:03,211 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 10:08:03,211 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43301,1690106767667' in zk 2023-07-23 10:08:03,217 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:03,217 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 10:08:03,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:03,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:08:03,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:08:03,217 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:08:03,217 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1690106767667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 10:08:03,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:08:03,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:08:03,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:03,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:03,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:03,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:08:03,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:03,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:03,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:03,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43301,1690106767667': 2023-07-23 10:08:03,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43301,1690106767667' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-23 10:08:03,227 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-23 10:08:03,227 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:08:03,227 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:08:03,227 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,227 INFO [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:08:03,229 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,229 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,229 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,229 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:03,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,229 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:03,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:08:03,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:08:03,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:03,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:03,230 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:03,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:03,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:03,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:08:03,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,230 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,230 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:03,230 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:03,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:03,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:03,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,232 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:03,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:08:03,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:03,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:03,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:03,234 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:03,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:08:03,235 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:03,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,235 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:03,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:03,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:03,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:03,240 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:03,240 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,240 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:03,240 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:03,241 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:03,241 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:03,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:03,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:03,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:03,241 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:03,241 DEBUG [(jenkins-hbase4.apache.org,39043,1690106766136)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:08:03,241 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,241 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,241 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:03,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,241 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:03,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:03,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:03,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:03,243 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:03,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:03,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:03,241 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:03,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:03,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:03,243 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,243 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:03,243 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:03,243 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,243 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:03,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:03,268 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,683 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:08:03,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 10:08:03,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:08:03,684 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-23 10:08:03,690 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-23 10:08:03,690 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,691 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,691 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690106882575Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690106883243 (+668 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1690106883243Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1690106883246 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690106883260 (+14 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690106883690 (+430 ms) 2023-07-23 10:08:03,694 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 10:08:03,701 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 1.1180 sec 2023-07-23 10:08:04,685 DEBUG [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:08:04,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 10:08:04,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:08:04,686 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106884686 2023-07-23 10:08:04,686 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39321, tgtDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106884686, rawTgtDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106884686, srcFsUri=hdfs://localhost:39321, srcDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa 2023-07-23 10:08:04,715 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39321, inputRoot=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa 2023-07-23 10:08:04,715 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1881201049_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106884686, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106884686/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:04,715 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39321, inputRoot=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa, snapshotDir=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-23 10:08:04,730 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106884686/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:04,760 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:04,761 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:04,761 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:04,761 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:04,762 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:04,762 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:04,763 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:04,838 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/hadoop-6822493128724843059.jar 2023-07-23 10:08:04,839 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:04,839 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:04,840 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:04,840 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:04,840 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:04,841 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:04,841 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 10:08:04,841 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 10:08:04,842 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 10:08:04,843 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 10:08:04,843 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 10:08:04,844 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 10:08:04,844 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 10:08:04,844 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 10:08:04,845 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 10:08:04,845 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 10:08:04,846 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:08:04,846 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:08:04,847 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:08:04,847 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:08:04,847 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:08:04,847 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:08:04,848 DEBUG [Listener at jenkins-hbase4.apache.org/44999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:08:05,265 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0006_000001 (auth:SIMPLE) 2023-07-23 10:08:05,486 WARN [Listener at jenkins-hbase4.apache.org/44999] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 10:08:05,488 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-23 10:08:05,491 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-23 10:08:05,571 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:08:05,571 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:08:05,862 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0007_000001 (auth:SIMPLE) 2023-07-23 10:08:06,718 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 10:08:11,781 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0007_000001 (auth:SIMPLE) 2023-07-23 10:08:14,065 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0007_000001 (auth:SIMPLE) 2023-07-23 10:08:17,681 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106776904_0007_000001 (auth:SIMPLE) 2023-07-23 10:08:18,763 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 10:08:18,763 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 10:08:18,796 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:18,796 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 10:08:18,797 INFO [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 10:08:18,797 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-372295689_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:18,798 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-23 10:08:18,798 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-23 10:08:18,798 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-372295689_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106884686/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106884686/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:18,798 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106884686/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-23 10:08:18,799 DEBUG [Listener at jenkins-hbase4.apache.org/44999] snapshot.TestExportSnapshot(367): hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/export-test/export-1690106884686/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-23 10:08:18,815 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:18,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:18,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:18,823 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106898823"}]},"ts":"1690106898823"} 2023-07-23 10:08:18,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-23 10:08:18,824 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-23 10:08:18,826 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-23 10:08:18,827 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=eaec5127012c2c2cfd6a4c89e468485c, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e9d87894eb41d30529b5722847d9b2f8, UNASSIGN}] 2023-07-23 10:08:18,828 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e9d87894eb41d30529b5722847d9b2f8, UNASSIGN 2023-07-23 10:08:18,831 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=eaec5127012c2c2cfd6a4c89e468485c, UNASSIGN 2023-07-23 10:08:18,832 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=e9d87894eb41d30529b5722847d9b2f8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:18,832 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690106898832"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106898832"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106898832"}]},"ts":"1690106898832"} 2023-07-23 10:08:18,833 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=eaec5127012c2c2cfd6a4c89e468485c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:18,833 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690106898833"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106898833"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106898833"}]},"ts":"1690106898833"} 2023-07-23 10:08:18,834 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure e9d87894eb41d30529b5722847d9b2f8, server=jenkins-hbase4.apache.org,44315,1690106767755}] 2023-07-23 10:08:18,835 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure eaec5127012c2c2cfd6a4c89e468485c, server=jenkins-hbase4.apache.org,43301,1690106767667}] 2023-07-23 10:08:18,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-23 10:08:18,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e9d87894eb41d30529b5722847d9b2f8 2023-07-23 10:08:18,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e9d87894eb41d30529b5722847d9b2f8, disabling compactions & flushes 2023-07-23 10:08:18,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8. 2023-07-23 10:08:18,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8. 2023-07-23 10:08:18,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8. after waiting 0 ms 2023-07-23 10:08:18,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8. 2023-07-23 10:08:18,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close eaec5127012c2c2cfd6a4c89e468485c 2023-07-23 10:08:18,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing eaec5127012c2c2cfd6a4c89e468485c, disabling compactions & flushes 2023-07-23 10:08:18,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. 2023-07-23 10:08:18,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. 2023-07-23 10:08:18,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. after waiting 0 ms 2023-07-23 10:08:18,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. 2023-07-23 10:08:18,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9d87894eb41d30529b5722847d9b2f8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:08:19,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/default/testtb-testExportFileSystemStateWithSkipTmp/eaec5127012c2c2cfd6a4c89e468485c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:08:19,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:08:19,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8. 2023-07-23 10:08:19,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e9d87894eb41d30529b5722847d9b2f8: 2023-07-23 10:08:19,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:08:19,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c. 2023-07-23 10:08:19,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for eaec5127012c2c2cfd6a4c89e468485c: 2023-07-23 10:08:19,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e9d87894eb41d30529b5722847d9b2f8 2023-07-23 10:08:19,015 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=e9d87894eb41d30529b5722847d9b2f8, regionState=CLOSED 2023-07-23 10:08:19,015 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690106899015"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106899015"}]},"ts":"1690106899015"} 2023-07-23 10:08:19,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed eaec5127012c2c2cfd6a4c89e468485c 2023-07-23 10:08:19,016 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=eaec5127012c2c2cfd6a4c89e468485c, regionState=CLOSED 2023-07-23 10:08:19,016 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690106899016"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106899016"}]},"ts":"1690106899016"} 2023-07-23 10:08:19,021 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-23 10:08:19,021 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure e9d87894eb41d30529b5722847d9b2f8, server=jenkins-hbase4.apache.org,44315,1690106767755 in 183 msec 2023-07-23 10:08:19,022 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-23 10:08:19,022 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure eaec5127012c2c2cfd6a4c89e468485c, server=jenkins-hbase4.apache.org,43301,1690106767667 in 183 msec 2023-07-23 10:08:19,023 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e9d87894eb41d30529b5722847d9b2f8, UNASSIGN in 194 msec 2023-07-23 10:08:19,024 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-23 10:08:19,024 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=eaec5127012c2c2cfd6a4c89e468485c, UNASSIGN in 195 msec 2023-07-23 10:08:19,025 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106899025"}]},"ts":"1690106899025"} 2023-07-23 10:08:19,026 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-23 10:08:19,028 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-23 10:08:19,030 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 212 msec 2023-07-23 10:08:19,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-23 10:08:19,126 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-23 10:08:19,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:19,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:19,130 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:19,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:19,131 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:19,132 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:19,135 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:19,135 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:19,135 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:19,135 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:19,135 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 10:08:19,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 10:08:19,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 10:08:19,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 10:08:19,138 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/eaec5127012c2c2cfd6a4c89e468485c 2023-07-23 10:08:19,139 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:19,139 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:19,139 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:19,139 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:19,139 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:19,139 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:19,139 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:19,139 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:19,139 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9d87894eb41d30529b5722847d9b2f8 2023-07-23 10:08:19,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-23 10:08:19,142 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9d87894eb41d30529b5722847d9b2f8/cf, FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9d87894eb41d30529b5722847d9b2f8/recovered.edits] 2023-07-23 10:08:19,142 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/eaec5127012c2c2cfd6a4c89e468485c/cf, FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/eaec5127012c2c2cfd6a4c89e468485c/recovered.edits] 2023-07-23 10:08:19,146 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9d87894eb41d30529b5722847d9b2f8/cf/d8806ef984684b8784701b700f13ef33 to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9d87894eb41d30529b5722847d9b2f8/cf/d8806ef984684b8784701b700f13ef33 2023-07-23 10:08:19,146 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/eaec5127012c2c2cfd6a4c89e468485c/cf/335c559aff404852ae9f8b4c493e36bc to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/eaec5127012c2c2cfd6a4c89e468485c/cf/335c559aff404852ae9f8b4c493e36bc 2023-07-23 10:08:19,149 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9d87894eb41d30529b5722847d9b2f8/recovered.edits/9.seqid to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9d87894eb41d30529b5722847d9b2f8/recovered.edits/9.seqid 2023-07-23 10:08:19,150 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/eaec5127012c2c2cfd6a4c89e468485c/recovered.edits/9.seqid to hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/eaec5127012c2c2cfd6a4c89e468485c/recovered.edits/9.seqid 2023-07-23 10:08:19,150 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9d87894eb41d30529b5722847d9b2f8 2023-07-23 10:08:19,150 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/eaec5127012c2c2cfd6a4c89e468485c 2023-07-23 10:08:19,150 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-23 10:08:19,152 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:19,154 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-23 10:08:19,156 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-23 10:08:19,157 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:19,158 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-23 10:08:19,158 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106899158"}]},"ts":"9223372036854775807"} 2023-07-23 10:08:19,158 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106899158"}]},"ts":"9223372036854775807"} 2023-07-23 10:08:19,160 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 10:08:19,160 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => eaec5127012c2c2cfd6a4c89e468485c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690106881427.eaec5127012c2c2cfd6a4c89e468485c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e9d87894eb41d30529b5722847d9b2f8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690106881427.e9d87894eb41d30529b5722847d9b2f8.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 10:08:19,160 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-23 10:08:19,160 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690106899160"}]},"ts":"9223372036854775807"} 2023-07-23 10:08:19,173 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-23 10:08:19,176 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:19,179 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 49 msec 2023-07-23 10:08:19,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-23 10:08:19,241 INFO [Listener at jenkins-hbase4.apache.org/44999] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-23 10:08:19,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-23 10:08:19,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:19,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-23 10:08:19,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39043] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:19,290 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=768 (was 765) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:39517 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-813619786_1 at /127.0.0.1:50418 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5445 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-813619786_1 at /127.0.0.1:56050 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a736194-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-372295689_17 at /127.0.0.1:56072 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-372295689_17 at /127.0.0.1:55380 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-372295689_17 at /127.0.0.1:50436 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a736194-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a736194-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a736194-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=904 (was 909), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=657 (was 575) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 180) - ProcessCount LEAK? -, AvailableMemoryMB=4152 (was 5042) 2023-07-23 10:08:19,290 WARN [Listener at jenkins-hbase4.apache.org/44999] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-23 10:08:19,290 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-23 10:08:19,302 INFO [Listener at jenkins-hbase4.apache.org/44999] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 10:08:19,431 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1690106776904_0007_01_000001 is : 143 2023-07-23 10:08:24,578 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 10:08:33,429 INFO [Listener at jenkins-hbase4.apache.org/44999] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 10:08:47,546 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-23 10:08:47,547 INFO [Listener at jenkins-hbase4.apache.org/44999] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 10:08:47,656 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-23 10:08:47,663 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-23 10:08:47,664 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-23 10:08:47,676 INFO [Listener at jenkins-hbase4.apache.org/44999] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 10:08:47,780 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-23 10:08:47,780 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-23 10:08:47,780 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-23 10:08:47,780 INFO [Listener at jenkins-hbase4.apache.org/44999] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-23 10:08:47,780 DEBUG [Listener at jenkins-hbase4.apache.org/44999] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76a534fc to 127.0.0.1:61286 2023-07-23 10:08:47,780 DEBUG [Listener at jenkins-hbase4.apache.org/44999] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:47,781 DEBUG [Listener at jenkins-hbase4.apache.org/44999] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-23 10:08:47,781 DEBUG [Listener at jenkins-hbase4.apache.org/44999] util.JVMClusterUtil(257): Found active master hash=1608091475, stopped=false 2023-07-23 10:08:47,781 DEBUG [Listener at jenkins-hbase4.apache.org/44999] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:08:47,781 DEBUG [Listener at jenkins-hbase4.apache.org/44999] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-23 10:08:47,781 INFO [Listener at jenkins-hbase4.apache.org/44999] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39043,1690106766136 2023-07-23 10:08:47,782 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 10:08:47,782 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 10:08:47,782 INFO [Listener at jenkins-hbase4.apache.org/44999] procedure2.ProcedureExecutor(629): Stopping 2023-07-23 10:08:47,782 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 10:08:47,783 DEBUG [Listener at jenkins-hbase4.apache.org/44999] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7eb6cbfc to 127.0.0.1:61286 2023-07-23 10:08:47,782 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 10:08:47,783 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 10:08:47,783 DEBUG [Listener at jenkins-hbase4.apache.org/44999] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:47,783 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 10:08:47,783 INFO [Listener at jenkins-hbase4.apache.org/44999] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43301,1690106767667' ***** 2023-07-23 10:08:47,783 DEBUG [Listener at jenkins-hbase4.apache.org/44999] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:08:47,783 INFO [Listener at jenkins-hbase4.apache.org/44999] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-23 10:08:47,784 INFO [Listener at jenkins-hbase4.apache.org/44999] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44315,1690106767755' ***** 2023-07-23 10:08:47,784 DEBUG [Listener at jenkins-hbase4.apache.org/44999] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:08:47,784 INFO [Listener at jenkins-hbase4.apache.org/44999] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-23 10:08:47,784 INFO [Listener at jenkins-hbase4.apache.org/44999] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35943,1690106767812' ***** 2023-07-23 10:08:47,784 DEBUG [Listener at jenkins-hbase4.apache.org/44999] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:08:47,784 INFO [RS:0;jenkins-hbase4:43301] regionserver.HeapMemoryManager(220): Stopping 2023-07-23 10:08:47,784 INFO [RS:1;jenkins-hbase4:44315] regionserver.HeapMemoryManager(220): Stopping 2023-07-23 10:08:47,784 INFO [Listener at jenkins-hbase4.apache.org/44999] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-23 10:08:47,784 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 10:08:47,784 INFO [RS:2;jenkins-hbase4:35943] regionserver.HeapMemoryManager(220): Stopping 2023-07-23 10:08:47,784 INFO [RS:2;jenkins-hbase4:35943] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-23 10:08:47,784 INFO [RS:1;jenkins-hbase4:44315] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-23 10:08:47,785 INFO [RS:2;jenkins-hbase4:35943] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-23 10:08:47,784 INFO [RS:0;jenkins-hbase4:43301] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-23 10:08:47,785 INFO [RS:1;jenkins-hbase4:44315] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-23 10:08:47,785 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 10:08:47,785 INFO [RS:1;jenkins-hbase4:44315] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:47,785 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-23 10:08:47,785 DEBUG [RS:1;jenkins-hbase4:44315] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3054ce79 to 127.0.0.1:61286 2023-07-23 10:08:47,784 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-23 10:08:47,785 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 10:08:47,784 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-23 10:08:47,785 DEBUG [RS:1;jenkins-hbase4:44315] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:47,785 INFO [RS:2;jenkins-hbase4:35943] regionserver.HRegionServer(3305): Received CLOSE for d3eb2f372d792f1e136075e91f7a577c 2023-07-23 10:08:47,785 INFO [RS:0;jenkins-hbase4:43301] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-23 10:08:47,786 INFO [RS:0;jenkins-hbase4:43301] regionserver.HRegionServer(3305): Received CLOSE for d7b2ad965da79b07eaeb88f95f4adbe8 2023-07-23 10:08:47,786 INFO [RS:2;jenkins-hbase4:35943] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:47,786 INFO [RS:0;jenkins-hbase4:43301] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:47,789 INFO [RS:1;jenkins-hbase4:44315] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-23 10:08:47,790 DEBUG [RS:0;jenkins-hbase4:43301] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a1a8aed to 127.0.0.1:61286 2023-07-23 10:08:47,791 DEBUG [RS:0;jenkins-hbase4:43301] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:47,791 INFO [RS:0;jenkins-hbase4:43301] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-23 10:08:47,792 DEBUG [RS:0;jenkins-hbase4:43301] regionserver.HRegionServer(1478): Online Regions={d7b2ad965da79b07eaeb88f95f4adbe8=hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8.} 2023-07-23 10:08:47,792 DEBUG [RS:0;jenkins-hbase4:43301] regionserver.HRegionServer(1504): Waiting on d7b2ad965da79b07eaeb88f95f4adbe8 2023-07-23 10:08:47,786 DEBUG [RS:2;jenkins-hbase4:35943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10907810 to 127.0.0.1:61286 2023-07-23 10:08:47,798 DEBUG [RS:2;jenkins-hbase4:35943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:47,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d7b2ad965da79b07eaeb88f95f4adbe8, disabling compactions & flushes 2023-07-23 10:08:47,790 INFO [RS:1;jenkins-hbase4:44315] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-23 10:08:47,798 INFO [RS:1;jenkins-hbase4:44315] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-23 10:08:47,798 INFO [RS:1;jenkins-hbase4:44315] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-23 10:08:47,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d3eb2f372d792f1e136075e91f7a577c, disabling compactions & flushes 2023-07-23 10:08:47,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c. 2023-07-23 10:08:47,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c. 2023-07-23 10:08:47,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c. after waiting 0 ms 2023-07-23 10:08:47,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c. 2023-07-23 10:08:47,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d3eb2f372d792f1e136075e91f7a577c 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-23 10:08:47,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8. 2023-07-23 10:08:47,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8. 2023-07-23 10:08:47,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8. after waiting 0 ms 2023-07-23 10:08:47,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8. 2023-07-23 10:08:47,799 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d7b2ad965da79b07eaeb88f95f4adbe8 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-23 10:08:47,803 INFO [RS:1;jenkins-hbase4:44315] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-23 10:08:47,803 INFO [RS:2;jenkins-hbase4:35943] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-23 10:08:47,803 DEBUG [RS:1;jenkins-hbase4:44315] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-23 10:08:47,803 DEBUG [RS:2;jenkins-hbase4:35943] regionserver.HRegionServer(1478): Online Regions={d3eb2f372d792f1e136075e91f7a577c=hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c.} 2023-07-23 10:08:47,804 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-23 10:08:47,804 DEBUG [RS:1;jenkins-hbase4:44315] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-23 10:08:47,804 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-23 10:08:47,804 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-23 10:08:47,804 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-23 10:08:47,804 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-23 10:08:47,805 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-23 10:08:47,804 DEBUG [RS:2;jenkins-hbase4:35943] regionserver.HRegionServer(1504): Waiting on d3eb2f372d792f1e136075e91f7a577c 2023-07-23 10:08:47,805 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-23 10:08:47,816 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-23 10:08:47,816 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-23 10:08:47,822 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-23 10:08:47,822 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-23 10:08:47,827 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-23 10:08:47,827 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-23 10:08:47,834 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-23 10:08:47,838 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-23 10:08:47,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/acl/d7b2ad965da79b07eaeb88f95f4adbe8/.tmp/l/3509392fd79047c5ac84c95bcf92d7a7 2023-07-23 10:08:47,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/namespace/d3eb2f372d792f1e136075e91f7a577c/.tmp/info/3b965a57432a4e10872fbceda8cf394a 2023-07-23 10:08:47,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3509392fd79047c5ac84c95bcf92d7a7 2023-07-23 10:08:47,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/acl/d7b2ad965da79b07eaeb88f95f4adbe8/.tmp/l/3509392fd79047c5ac84c95bcf92d7a7 as hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/acl/d7b2ad965da79b07eaeb88f95f4adbe8/l/3509392fd79047c5ac84c95bcf92d7a7 2023-07-23 10:08:47,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3509392fd79047c5ac84c95bcf92d7a7 2023-07-23 10:08:47,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/acl/d7b2ad965da79b07eaeb88f95f4adbe8/l/3509392fd79047c5ac84c95bcf92d7a7, entries=7, sequenceid=18, filesize=5.2 K 2023-07-23 10:08:47,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for d7b2ad965da79b07eaeb88f95f4adbe8 in 80ms, sequenceid=18, compaction requested=false 2023-07-23 10:08:47,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/namespace/d3eb2f372d792f1e136075e91f7a577c/.tmp/info/3b965a57432a4e10872fbceda8cf394a as hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/namespace/d3eb2f372d792f1e136075e91f7a577c/info/3b965a57432a4e10872fbceda8cf394a 2023-07-23 10:08:47,889 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740/.tmp/info/29dcf7c346f34b82b47e323eecb89fd9 2023-07-23 10:08:47,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/namespace/d3eb2f372d792f1e136075e91f7a577c/info/3b965a57432a4e10872fbceda8cf394a, entries=2, sequenceid=6, filesize=4.8 K 2023-07-23 10:08:47,894 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d3eb2f372d792f1e136075e91f7a577c in 96ms, sequenceid=6, compaction requested=false 2023-07-23 10:08:47,901 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 29dcf7c346f34b82b47e323eecb89fd9 2023-07-23 10:08:47,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/acl/d7b2ad965da79b07eaeb88f95f4adbe8/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-23 10:08:47,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:08:47,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8. 2023-07-23 10:08:47,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d7b2ad965da79b07eaeb88f95f4adbe8: 2023-07-23 10:08:47,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690106771724.d7b2ad965da79b07eaeb88f95f4adbe8. 2023-07-23 10:08:47,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/namespace/d3eb2f372d792f1e136075e91f7a577c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:08:47,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:08:47,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c. 2023-07-23 10:08:47,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d3eb2f372d792f1e136075e91f7a577c: 2023-07-23 10:08:47,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690106770910.d3eb2f372d792f1e136075e91f7a577c. 2023-07-23 10:08:47,919 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740/.tmp/rep_barrier/505b3af32d3a4a07bfd0ddc8a966799d 2023-07-23 10:08:47,924 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 505b3af32d3a4a07bfd0ddc8a966799d 2023-07-23 10:08:47,961 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740/.tmp/table/5f3a5f92e04845d78c9105218d125400 2023-07-23 10:08:47,966 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5f3a5f92e04845d78c9105218d125400 2023-07-23 10:08:47,967 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740/.tmp/info/29dcf7c346f34b82b47e323eecb89fd9 as hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740/info/29dcf7c346f34b82b47e323eecb89fd9 2023-07-23 10:08:47,971 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 29dcf7c346f34b82b47e323eecb89fd9 2023-07-23 10:08:47,971 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740/info/29dcf7c346f34b82b47e323eecb89fd9, entries=48, sequenceid=131, filesize=10.3 K 2023-07-23 10:08:47,972 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740/.tmp/rep_barrier/505b3af32d3a4a07bfd0ddc8a966799d as hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740/rep_barrier/505b3af32d3a4a07bfd0ddc8a966799d 2023-07-23 10:08:47,977 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 505b3af32d3a4a07bfd0ddc8a966799d 2023-07-23 10:08:47,977 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740/rep_barrier/505b3af32d3a4a07bfd0ddc8a966799d, entries=13, sequenceid=131, filesize=6.4 K 2023-07-23 10:08:47,978 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740/.tmp/table/5f3a5f92e04845d78c9105218d125400 as hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740/table/5f3a5f92e04845d78c9105218d125400 2023-07-23 10:08:47,989 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5f3a5f92e04845d78c9105218d125400 2023-07-23 10:08:47,989 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740/table/5f3a5f92e04845d78c9105218d125400, entries=24, sequenceid=131, filesize=6.9 K 2023-07-23 10:08:47,990 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 185ms, sequenceid=131, compaction requested=false 2023-07-23 10:08:47,993 INFO [RS:0;jenkins-hbase4:43301] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43301,1690106767667; all regions closed. 2023-07-23 10:08:48,005 INFO [RS:2;jenkins-hbase4:35943] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35943,1690106767812; all regions closed. 2023-07-23 10:08:48,006 DEBUG [RS:1;jenkins-hbase4:44315] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-23 10:08:48,034 DEBUG [RS:2;jenkins-hbase4:35943] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/oldWALs 2023-07-23 10:08:48,034 INFO [RS:2;jenkins-hbase4:35943] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35943%2C1690106767812:(num 1690106770031) 2023-07-23 10:08:48,034 DEBUG [RS:2;jenkins-hbase4:35943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:48,034 INFO [RS:2;jenkins-hbase4:35943] regionserver.LeaseManager(133): Closed leases 2023-07-23 10:08:48,035 INFO [RS:2;jenkins-hbase4:35943] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-23 10:08:48,035 INFO [RS:2;jenkins-hbase4:35943] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-23 10:08:48,035 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 10:08:48,035 INFO [RS:2;jenkins-hbase4:35943] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-23 10:08:48,035 INFO [RS:2;jenkins-hbase4:35943] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-23 10:08:48,043 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-23 10:08:48,045 INFO [RS:2;jenkins-hbase4:35943] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35943 2023-07-23 10:08:48,045 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:08:48,045 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-23 10:08:48,046 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-23 10:08:48,046 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-23 10:08:48,046 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-23 10:08:48,051 DEBUG [RS:0;jenkins-hbase4:43301] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/oldWALs 2023-07-23 10:08:48,051 INFO [RS:0;jenkins-hbase4:43301] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43301%2C1690106767667:(num 1690106770031) 2023-07-23 10:08:48,051 DEBUG [RS:0;jenkins-hbase4:43301] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:48,051 INFO [RS:0;jenkins-hbase4:43301] regionserver.LeaseManager(133): Closed leases 2023-07-23 10:08:48,051 INFO [RS:0;jenkins-hbase4:43301] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-23 10:08:48,053 INFO [RS:0;jenkins-hbase4:43301] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-23 10:08:48,053 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 10:08:48,053 INFO [RS:0;jenkins-hbase4:43301] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-23 10:08:48,053 INFO [RS:0;jenkins-hbase4:43301] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-23 10:08:48,055 INFO [RS:0;jenkins-hbase4:43301] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43301 2023-07-23 10:08:48,055 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 10:08:48,055 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:48,056 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:48,056 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 10:08:48,056 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 10:08:48,055 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35943,1690106767812 2023-07-23 10:08:48,056 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 10:08:48,056 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35943,1690106767812] 2023-07-23 10:08:48,057 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35943,1690106767812; numProcessing=1 2023-07-23 10:08:48,058 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:48,058 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43301,1690106767667 2023-07-23 10:08:48,059 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 10:08:48,059 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35943,1690106767812 already deleted, retry=false 2023-07-23 10:08:48,060 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35943,1690106767812 expired; onlineServers=2 2023-07-23 10:08:48,061 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43301,1690106767667] 2023-07-23 10:08:48,061 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43301,1690106767667; numProcessing=2 2023-07-23 10:08:48,062 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43301,1690106767667 already deleted, retry=false 2023-07-23 10:08:48,062 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43301,1690106767667 expired; onlineServers=1 2023-07-23 10:08:48,158 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 10:08:48,158 INFO [RS:2;jenkins-hbase4:35943] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35943,1690106767812; zookeeper connection closed. 2023-07-23 10:08:48,158 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:35943-0x10191a5228d0003, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 10:08:48,158 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@412660f3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@412660f3 2023-07-23 10:08:48,207 INFO [RS:1;jenkins-hbase4:44315] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44315,1690106767755; all regions closed. 2023-07-23 10:08:48,221 DEBUG [RS:1;jenkins-hbase4:44315] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/oldWALs 2023-07-23 10:08:48,221 INFO [RS:1;jenkins-hbase4:44315] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44315%2C1690106767755.meta:.meta(num 1690106770622) 2023-07-23 10:08:48,231 DEBUG [RS:1;jenkins-hbase4:44315] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/oldWALs 2023-07-23 10:08:48,231 INFO [RS:1;jenkins-hbase4:44315] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44315%2C1690106767755:(num 1690106770031) 2023-07-23 10:08:48,231 DEBUG [RS:1;jenkins-hbase4:44315] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:48,231 INFO [RS:1;jenkins-hbase4:44315] regionserver.LeaseManager(133): Closed leases 2023-07-23 10:08:48,231 INFO [RS:1;jenkins-hbase4:44315] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-23 10:08:48,232 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 10:08:48,232 INFO [RS:1;jenkins-hbase4:44315] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44315 2023-07-23 10:08:48,234 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 10:08:48,234 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44315,1690106767755 2023-07-23 10:08:48,235 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44315,1690106767755] 2023-07-23 10:08:48,236 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44315,1690106767755; numProcessing=3 2023-07-23 10:08:48,238 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44315,1690106767755 already deleted, retry=false 2023-07-23 10:08:48,238 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44315,1690106767755 expired; onlineServers=0 2023-07-23 10:08:48,238 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39043,1690106766136' ***** 2023-07-23 10:08:48,238 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-23 10:08:48,238 DEBUG [M:0;jenkins-hbase4:39043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ee48d68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 10:08:48,239 INFO [M:0;jenkins-hbase4:39043] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39043,1690106766136 2023-07-23 10:08:48,239 INFO [M:0;jenkins-hbase4:39043] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39043,1690106766136; all regions closed. 2023-07-23 10:08:48,239 DEBUG [M:0;jenkins-hbase4:39043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:48,239 DEBUG [M:0;jenkins-hbase4:39043] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-23 10:08:48,239 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-23 10:08:48,239 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690106769525] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690106769525,5,FailOnTimeoutGroup] 2023-07-23 10:08:48,239 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690106769531] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690106769531,5,FailOnTimeoutGroup] 2023-07-23 10:08:48,239 DEBUG [M:0;jenkins-hbase4:39043] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-23 10:08:48,239 INFO [M:0;jenkins-hbase4:39043] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-23 10:08:48,239 INFO [M:0;jenkins-hbase4:39043] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-23 10:08:48,239 INFO [M:0;jenkins-hbase4:39043] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-23 10:08:48,240 DEBUG [M:0;jenkins-hbase4:39043] master.HMaster(1512): Stopping service threads 2023-07-23 10:08:48,240 INFO [M:0;jenkins-hbase4:39043] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-23 10:08:48,240 ERROR [M:0;jenkins-hbase4:39043] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-23 10:08:48,240 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-23 10:08:48,240 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 10:08:48,241 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 10:08:48,241 INFO [M:0;jenkins-hbase4:39043] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-23 10:08:48,241 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-23 10:08:48,242 DEBUG [M:0;jenkins-hbase4:39043] zookeeper.ZKUtil(398): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-23 10:08:48,242 WARN [M:0;jenkins-hbase4:39043] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-23 10:08:48,242 INFO [M:0;jenkins-hbase4:39043] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-23 10:08:48,242 INFO [M:0;jenkins-hbase4:39043] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-23 10:08:48,243 DEBUG [M:0;jenkins-hbase4:39043] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-23 10:08:48,243 INFO [M:0;jenkins-hbase4:39043] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 10:08:48,243 DEBUG [M:0;jenkins-hbase4:39043] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 10:08:48,243 DEBUG [M:0;jenkins-hbase4:39043] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-23 10:08:48,243 DEBUG [M:0;jenkins-hbase4:39043] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 10:08:48,243 INFO [M:0;jenkins-hbase4:39043] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.33 KB heapSize=449.52 KB 2023-07-23 10:08:48,258 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 10:08:48,258 INFO [RS:0;jenkins-hbase4:43301] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43301,1690106767667; zookeeper connection closed. 2023-07-23 10:08:48,258 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10191a5228d0001, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 10:08:48,262 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6bf08992] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6bf08992 2023-07-23 10:08:48,263 INFO [M:0;jenkins-hbase4:39043] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.33 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b9a1f0db384142a7b245903a6e9d4ba7 2023-07-23 10:08:48,266 INFO [M:0;jenkins-hbase4:39043] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b9a1f0db384142a7b245903a6e9d4ba7 2023-07-23 10:08:48,267 DEBUG [M:0;jenkins-hbase4:39043] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b9a1f0db384142a7b245903a6e9d4ba7 as hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b9a1f0db384142a7b245903a6e9d4ba7 2023-07-23 10:08:48,271 INFO [M:0;jenkins-hbase4:39043] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b9a1f0db384142a7b245903a6e9d4ba7 2023-07-23 10:08:48,271 INFO [M:0;jenkins-hbase4:39043] regionserver.HStore(1080): Added hdfs://localhost:39321/user/jenkins/test-data/3d19c4c8-f87c-f9b0-52d9-df23dfe551aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b9a1f0db384142a7b245903a6e9d4ba7, entries=119, sequenceid=899, filesize=28.5 K 2023-07-23 10:08:48,272 INFO [M:0;jenkins-hbase4:39043] regionserver.HRegion(2948): Finished flush of dataSize ~373.33 KB/382292, heapSize ~449.51 KB/460296, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 29ms, sequenceid=899, compaction requested=false 2023-07-23 10:08:48,274 INFO [M:0;jenkins-hbase4:39043] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 10:08:48,274 DEBUG [M:0;jenkins-hbase4:39043] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-23 10:08:48,281 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 10:08:48,281 INFO [M:0;jenkins-hbase4:39043] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-23 10:08:48,282 INFO [M:0;jenkins-hbase4:39043] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39043 2023-07-23 10:08:48,284 DEBUG [M:0;jenkins-hbase4:39043] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39043,1690106766136 already deleted, retry=false 2023-07-23 10:08:48,358 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 10:08:48,358 INFO [RS:1;jenkins-hbase4:44315] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44315,1690106767755; zookeeper connection closed. 2023-07-23 10:08:48,358 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): regionserver:44315-0x10191a5228d0002, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 10:08:48,369 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1ad9bf54] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1ad9bf54 2023-07-23 10:08:48,369 INFO [Listener at jenkins-hbase4.apache.org/44999] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-23 10:08:48,458 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 10:08:48,459 INFO [M:0;jenkins-hbase4:39043] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39043,1690106766136; zookeeper connection closed. 2023-07-23 10:08:48,459 DEBUG [Listener at localhost/36111-EventThread] zookeeper.ZKWatcher(600): master:39043-0x10191a5228d0000, quorum=127.0.0.1:61286, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 10:08:48,461 WARN [Listener at jenkins-hbase4.apache.org/44999] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-23 10:08:48,466 INFO [Listener at jenkins-hbase4.apache.org/44999] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 10:08:48,569 WARN [BP-56960218-172.31.14.131-1690106762116 heartbeating to localhost/127.0.0.1:39321] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-23 10:08:48,569 WARN [BP-56960218-172.31.14.131-1690106762116 heartbeating to localhost/127.0.0.1:39321] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-56960218-172.31.14.131-1690106762116 (Datanode Uuid d5760c75-5569-430d-92d5-456423779f47) service to localhost/127.0.0.1:39321 2023-07-23 10:08:48,571 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/cluster_bd390da2-1551-9369-9467-7621abdbc80d/dfs/data/data5/current/BP-56960218-172.31.14.131-1690106762116] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 10:08:48,571 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/cluster_bd390da2-1551-9369-9467-7621abdbc80d/dfs/data/data6/current/BP-56960218-172.31.14.131-1690106762116] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 10:08:48,573 WARN [Listener at jenkins-hbase4.apache.org/44999] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-23 10:08:48,580 INFO [Listener at jenkins-hbase4.apache.org/44999] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 10:08:48,689 WARN [BP-56960218-172.31.14.131-1690106762116 heartbeating to localhost/127.0.0.1:39321] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-23 10:08:48,689 WARN [BP-56960218-172.31.14.131-1690106762116 heartbeating to localhost/127.0.0.1:39321] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-56960218-172.31.14.131-1690106762116 (Datanode Uuid ea0dbdab-18b5-414d-a068-45972d395ad1) service to localhost/127.0.0.1:39321 2023-07-23 10:08:48,690 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/cluster_bd390da2-1551-9369-9467-7621abdbc80d/dfs/data/data3/current/BP-56960218-172.31.14.131-1690106762116] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 10:08:48,690 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/cluster_bd390da2-1551-9369-9467-7621abdbc80d/dfs/data/data4/current/BP-56960218-172.31.14.131-1690106762116] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 10:08:48,692 WARN [Listener at jenkins-hbase4.apache.org/44999] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-23 10:08:48,700 INFO [Listener at jenkins-hbase4.apache.org/44999] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 10:08:48,705 WARN [BP-56960218-172.31.14.131-1690106762116 heartbeating to localhost/127.0.0.1:39321] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-23 10:08:48,705 WARN [BP-56960218-172.31.14.131-1690106762116 heartbeating to localhost/127.0.0.1:39321] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-56960218-172.31.14.131-1690106762116 (Datanode Uuid 654462dd-3c5e-4e67-8502-51b8a1082004) service to localhost/127.0.0.1:39321 2023-07-23 10:08:48,706 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/cluster_bd390da2-1551-9369-9467-7621abdbc80d/dfs/data/data1/current/BP-56960218-172.31.14.131-1690106762116] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 10:08:48,706 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0f75103c-fc07-18e6-d55c-6ed3a099d181/cluster_bd390da2-1551-9369-9467-7621abdbc80d/dfs/data/data2/current/BP-56960218-172.31.14.131-1690106762116] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 10:08:48,735 INFO [Listener at jenkins-hbase4.apache.org/44999] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 10:08:48,867 INFO [Listener at jenkins-hbase4.apache.org/44999] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-23 10:08:48,980 INFO [Listener at jenkins-hbase4.apache.org/44999] hbase.HBaseTestingUtility(1293): Minicluster is down